-- Logs begin at Thu 2022-06-02 09:21:22 UTC, end at Thu 2022-06-02 10:28:41 UTC. -- Jun 02 09:52:40.669581 dv-cinder-797608-25-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 09:52:40.679120 dv-cinder-797608-25-smb devstack@keystone.service[80286]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 09:52:40 2022] *** Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: nodename: dv-cinder-797608-25-smb Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: machine: x86_64 Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: clock source: unix Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: pcre jit disabled Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: detected number of CPU cores: 4 Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: current working directory: / Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: detected binary path: /usr/bin/uwsgi-core Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: your processes number limit is 47680 Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: your memory page size is 4096 bytes Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: detected max file descriptor number: 2048 Jun 02 09:52:40.681180 dv-cinder-797608-25-smb devstack@keystone.service[80286]: lock engine: pthread robust mutexes Jun 02 09:52:40.681923 dv-cinder-797608-25-smb devstack@keystone.service[80286]: thunder lock: enabled Jun 02 09:52:40.681923 dv-cinder-797608-25-smb devstack@keystone.service[80286]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 09:52:40.681923 dv-cinder-797608-25-smb devstack@keystone.service[80286]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 09:52:40.727238 dv-cinder-797608-25-smb devstack@keystone.service[80286]: Python main interpreter initialized at 0x55b91b0379c0 Jun 02 09:52:40.727238 dv-cinder-797608-25-smb devstack@keystone.service[80286]: python threads support enabled Jun 02 09:52:40.727238 dv-cinder-797608-25-smb devstack@keystone.service[80286]: your server socket listen backlog is limited to 100 connections Jun 02 09:52:40.727238 dv-cinder-797608-25-smb devstack@keystone.service[80286]: your mercy for graceful operations on workers is 90 seconds Jun 02 09:52:40.727604 dv-cinder-797608-25-smb devstack@keystone.service[80286]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 09:52:40.727688 dv-cinder-797608-25-smb devstack@keystone.service[80286]: *** Operational MODE: preforking *** Jun 02 09:52:40.727945 dv-cinder-797608-25-smb devstack@keystone.service[80286]: *** uWSGI is running in multiple interpreter mode *** Jun 02 09:52:40.727945 dv-cinder-797608-25-smb devstack@keystone.service[80286]: spawned uWSGI master process (pid: 80286) Jun 02 09:52:40.728144 dv-cinder-797608-25-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 02 09:52:40.729534 dv-cinder-797608-25-smb devstack@keystone.service[80286]: spawned uWSGI worker 1 (pid: 80299, cores: 1) Jun 02 09:52:40.729534 dv-cinder-797608-25-smb devstack@keystone.service[80286]: spawned uWSGI worker 2 (pid: 80300, cores: 1) Jun 02 09:52:40.735776 dv-cinder-797608-25-smb devstack@keystone.service[80286]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 09:52:46.502691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:52:46.502691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: from cryptography.utils import int_from_bytes Jun 02 09:52:46.503500 dv-cinder-797608-25-smb devstack@keystone.service[80300]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:52:46.503500 dv-cinder-797608-25-smb devstack@keystone.service[80300]: from cryptography.utils import int_from_bytes Jun 02 09:52:46.503646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:52:46.503646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: from cryptography.utils import int_from_bytes Jun 02 09:52:46.503646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 09:52:46.503646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: from cryptography.utils import int_from_bytes Jun 02 09:52:46.554632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 09:52:46.554835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 09:52:46.554996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 09:52:46.555093 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] command line args: [] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 09:52:46.555196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 09:52:46.555288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 09:52:46.555394 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] command line args: [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 09:52:46.555477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ================================================================================ {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 09:52:46.555691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 09:52:46.555783 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] admin_token = **** {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.555861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ================================================================================ {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 09:52:46.555944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] config_dir = [] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.556124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] admin_token = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.556208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.556307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] config_source = [] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.556389 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] config_dir = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.556490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] debug = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.556579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.556691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.556946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] config_source = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.556946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] debug = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.557073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.557142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.557231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.557291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.557479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.557587 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.557726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.557836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.557952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] list_limit = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.558056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.558758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] log_config_append = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.558869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.559012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.559161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_config_append = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.559269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] log_dir = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.559372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.559476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] log_file = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.559636 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_dir = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.559636 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_file = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.559836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.559914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.559992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.560068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.560145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.560309 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.560391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.560510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.560592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.560670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.560798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.560880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.560952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.561130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.561210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.561365 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.561497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.561603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.561681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.561837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.561963 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.562070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.562165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.562304 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.562391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.562549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.562631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.562797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.562881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.563079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.563305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.563493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] publish_errors = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.563603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.563753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.563881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] publish_errors = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.563988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.564065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.564180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.564253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.564391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.564469 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.564625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.564775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.564848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] standard_threads = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.564913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.565084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.565170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] standard_threads = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.565320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.565403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.565497 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.565578 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.565675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] use_journal = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.565764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.565840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] use_json = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.565912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] use_journal = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.566016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] use_stderr = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.566094 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] use_json = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.566193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] use_syslog = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.566280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] use_stderr = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.566394 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] use_syslog = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.566476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.566630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 09:52:46.566707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.566893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.566983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.567137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.567214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.567383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.567461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.567655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.567749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.567898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.567981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.568143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.568224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.568382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.568465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.568626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.568708 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.568874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.568956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.569124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.569208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.569360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.569435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.569606 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.569688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.569843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.569994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.570091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.570173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.570337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.570418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.570576 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.570660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.570814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.570903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.571074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.571151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.571318 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.571401 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.571557 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.571677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.571825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.571903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.572083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.572167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.572336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.572412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.572586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.572664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.572818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.572896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.573049 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.573138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.573281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.573358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.573514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.573591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.573825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.574400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.574578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.574707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.574831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.574909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.575032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.575108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.575279 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.575355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.575526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.575644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.575799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.575877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.576043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.576152 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.576261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.576388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.576493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.576591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.576721 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.576833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.576944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.577024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.577181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.577300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.577414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.577498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.577645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.577725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.577877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.577964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.578123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.578253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.578338 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.578411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.578581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.578669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.578814 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.578893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.579049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.579184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.579278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.579357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.579524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.579624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.579792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.579885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.580032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.580110 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.580270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.580348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.580508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.580590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.580746 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.580823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.580984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.581068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.581217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.581297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.581449 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.581526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.581693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.581775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.581930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.582009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.582163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.582241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.582398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.582551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.582648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.582732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.582881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.582965 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.583117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.583194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.583351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.583439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.583626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.583709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.583881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.583961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.584125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.584211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.584368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.584444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.584608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.584691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.584847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.584933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.585085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.585163 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.585324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.585401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.585564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.585654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.585804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.585883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.586044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.586121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.586283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.586360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.586523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.586602 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.586761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.586839 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.586998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.587081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.587234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.587312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.587472 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.587550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.587750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.587829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.587994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.588073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.588233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.588320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.588474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.588555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.588711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.588794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.588948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.589032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.589186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.589272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.589463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.589571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.589695 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.589780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.589926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.590004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.590165 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.590251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.590396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.590474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.590638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.590717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.590877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.590956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.591117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.591194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.591353 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.591436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.591621 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.591703 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.591882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.591959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.592123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.592201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.592356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] auth.external = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.592436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.592588 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.592667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.external = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.592822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.592900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.593108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.593247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.593335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] auth.password = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.593491 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.593571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] auth.token = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.593732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.password = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.593811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.593972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.token = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.594060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.594219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.594303 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.594463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.594543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.594711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.594802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.594947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.595026 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.595181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.595258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.595420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] credential.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.595507 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.595687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.595780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.595934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.596014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.596181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.596353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.596430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.596510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.596651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.596731 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.596904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.597055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.597134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.597206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.597370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.597449 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.597626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.597713 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.597877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.597956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.598119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.598197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.598377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.598458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.598642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.598721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.598884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.598965 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.599141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.599221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.599378 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] federation.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.599458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.599649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.599767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.599898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.599974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.600139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.600219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.600368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.600446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.600618 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.600698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.600854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.600933 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.601106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.601184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.601344 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.601425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.601600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.601679 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.601838 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.601916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.602087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.602168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.602327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.602405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.602574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.602656 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.602814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.602895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.603054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.603139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.603293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.603373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.603536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.603670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.603794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.603872 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.604033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.604113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.604268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.604354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.604512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.604591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.604741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.604820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.605000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.605088 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.605232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.605479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.605557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.605728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.605816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.605976 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.606056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.606232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.606312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.606478 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.606566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.606728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.606807 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.606982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.607060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.607222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.607303 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.607457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.607536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.607731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.607812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.607967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.608048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.608205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.608284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.608447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.608525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.608690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.608789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.608921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.609006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.609151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.609229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.609399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.609479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.609644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.609722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.609882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.609960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.610129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.610209 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.610377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.610456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.610608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.610685 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.610846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.610927 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.611080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.611160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.611316 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.611395 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.611553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.611686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.611815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.611893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.612052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.612140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.612290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.612370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.612533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.612651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.612778 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.612858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.613008 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.613087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.613240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.613320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.613488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.613568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.613722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.613801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.613959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.614039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.614196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.614275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.614435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.614515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.614669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.614748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.614908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.614991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.615152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.615280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.615388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.615516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.615653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.615803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.615918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.616052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.616155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.616301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.616405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.616541 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.616656 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.616782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.616905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.617024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.617147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.617264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.617381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.617503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.617622 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.617736 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.617862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.617988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.618102 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.618237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.618322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.618485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.618569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.618733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.618824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.618982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.619062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.619215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.619294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.619464 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.619665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.619744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.619817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.619955 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.620035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.620193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.620281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.620431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.621034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.621204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.621378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.621457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.621662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.621781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.621917 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.621998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.622147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.622226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.622395 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.622475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.622633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.622719 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.622872 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.622960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.623111 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.623196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.623355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.623434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.623612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.623706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.623848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.623928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.624086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.624166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.624328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] resource.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.624415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.624563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.624642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.624805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.624891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.625040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.625148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.625289 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.625369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.625542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.625620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.625788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.625873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.626027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.626107 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.626265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.626344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.626506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.626593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.626749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] role.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.626829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.626987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.627064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] role.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.627220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.627306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.627458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] role.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.627542 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.627733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] role.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.627814 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.627971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.628117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.628219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.628299 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.628468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.628546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.628714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.628801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.628963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.629042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.629210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.629288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.629443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.629529 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.629690 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.629773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.629940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.630025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.630173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.630259 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.630421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.630500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.630670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.630816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.630922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.631054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.631210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.631290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.631544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.631726 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.631815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.631892 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.632059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.632139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.632297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.632376 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.632552 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.632633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.632809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.632889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.633048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.633127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.633284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.633363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.633519 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.633599 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.633754 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.633833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.634005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.634084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.634244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.634376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.634480 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.634561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.634725 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.634804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.634965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.635045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.635197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.635276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.635436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] token.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.635517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.635697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.635788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.635935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.636015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.636749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.636859 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.637023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.637104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.637273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.637379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.637512 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.637631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.637758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.637896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.638003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.638151 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.638239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.638397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.638476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.638647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.638726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.638898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.638984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.639150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.639229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.639393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.639472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.639644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.639739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.639892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.639978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.640146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.640224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.640399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.640492 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.connection = **** {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.640636 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.640724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.640885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.640965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.641133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.641212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.641380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.641461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.connection = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.641607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.641692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.641848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.641935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.642088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.642168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.642328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.642408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.642574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.642654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.642813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.642900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.643052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.643131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.643290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.643374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.643535 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.643628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.643803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.643885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.644049 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.644131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.644281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.644368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.644524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.644603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.644760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.644839 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.644912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80300) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 09:52:46.644991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.645229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.645474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.645715 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 09:52:46.645888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 09:52:46.674565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.674797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.675026 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.675328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.675563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.675825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.684156 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.685201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.712886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.713122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.713817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.714056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.767431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.768126 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.816955 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.817192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.817690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.817930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.886051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.886685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.886815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.886924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.887046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.887131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.887273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.887399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.887509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.887710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.887797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.887938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.911920 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.912154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.912346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.912432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.912585 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.912669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.912804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.912912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.913025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.913108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.913247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.913326 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.913469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.913689 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.924762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.925343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.937631 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.937755 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.937912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.938052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.938182 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.938308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.938434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.938568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.938694 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.938819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.938942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.939066 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.939211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80300) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.939337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 09:52:46.956855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.957068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 09:52:46.957343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.957470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.957607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 09:52:46.957739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 09:52:46.957867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.957993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.958121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 09:52:46.958268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.958397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.958524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.958653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.958782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.958909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.959075 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.970357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.970637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.970863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.970989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.971152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.971292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.971419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.971729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.979499 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:46.980537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:46.983035 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:46.983319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.983622 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.983934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.984059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:46.984208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.984334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.984584 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.984711 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.984860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.984997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.985123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.985247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.985397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.985523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.985656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.985792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.985916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.986040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.986254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.986532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:46.986803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.013097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.014421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.014806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.015088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.016062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.016350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.020403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.020645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.020929 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.021627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.021929 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.022315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.028901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.029188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.030768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.031056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.033671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.034077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.034362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.034646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.034923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.035201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.035473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.035716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.035845 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.036011 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.036301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.036590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.036872 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.037155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.037433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.037708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.054939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.055212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.057219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.057504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.060601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.062869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.064286 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.064586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.066569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.066869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.069579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.071937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.073186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.075671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.078348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.078651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.078939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.079237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.079522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.079832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.080918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.081224 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.081514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.081802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.082084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.082370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.098739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.099024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.099291 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.099559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.101629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.102010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.102285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.102579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.108089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.109801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.110082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.111109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.112873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.113145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.113273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.113428 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.113713 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.113998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.114294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.116205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.116493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.116780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.117066 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.117346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.128376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.128656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.128936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.129215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.129497 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.129772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.130053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.131375 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.131682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.131970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.132255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.132543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.132828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.133108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.148425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.151257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.152295 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.155349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.156152 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.157760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.158691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.159397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.159702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.159987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.160348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.161987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.162273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.162561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.167470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.169116 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.170218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.171873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.172361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.172651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.172935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.173224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.175096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.175400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.175718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.176002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.182290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.182579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.182963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.186042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.186331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.186618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.191452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80300) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.191760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.192042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.192321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.192594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.192886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.193164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.193450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.193727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.193995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.194265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.194536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 09:52:47.194662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.194792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.194933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.195062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80300) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.195198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.195357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.195657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.195936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.196240 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.196531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.196806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.197077 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.197350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.197615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.197898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.198163 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 09:52:47.233546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b91b0379c0 pid: 80300 (default app) Jun 02 09:52:47.236578 dv-cinder-797608-25-smb devstack@keystone.service[80299]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b91b0379c0 pid: 80299 (default app) Jun 02 09:52:47.236821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dda12-f8a9-4f2a-8177-4130195524d1 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:52:47.237115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dda12-f8a9-4f2a-8177-4130195524d1 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:52:47.237396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dda12-f8a9-4f2a-8177-4130195524d1 None None] PATH_INFO: `/v3` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:52:47.241632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Thu Jun 2 09:52:47 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:52:56.144131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3475b-a62d-469d-99d2-8b50b4a2e9b6 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:52:56.144658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3475b-a62d-469d-99d2-8b50b4a2e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:52:56.144658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3475b-a62d-469d-99d2-8b50b4a2e9b6 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:52:56.148890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:52:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:52:56.154931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02059b-75e0-46e9-a05e-3a2d679326a7 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:52:56.158869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02059b-75e0-46e9-a05e-3a2d679326a7 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:52:56.158869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02059b-75e0-46e9-a05e-3a2d679326a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:52:56.225297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: INFO dbcounter [None req-ee02059b-75e0-46e9-a05e-3a2d679326a7 None None] Registered counter for database keystone Jun 02 09:52:56.247228 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG oslo_db.sqlalchemy.engines [None req-ee02059b-75e0-46e9-a05e-3a2d679326a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80300) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:52:56.253477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writer thread running {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:52:56.534547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG passlib.handlers.bcrypt [None req-ee02059b-75e0-46e9-a05e-3a2d679326a7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80300) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 09:52:56.534907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG passlib.handlers.bcrypt [None req-ee02059b-75e0-46e9-a05e-3a2d679326a7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80300) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 09:52:56.591096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-ee02059b-75e0-46e9-a05e-3a2d679326a7 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:52:56.592737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ee02059b-75e0-46e9-a05e-3a2d679326a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:52:56.714817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:52:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 561 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 02 09:52:56.907942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3475b-a62d-469d-99d2-8b50b4a2e9b6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:52:56.978761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: INFO dbcounter [None req-79d3475b-a62d-469d-99d2-8b50b4a2e9b6 None None] Registered counter for database keystone Jun 02 09:52:56.999293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG oslo_db.sqlalchemy.engines [None req-79d3475b-a62d-469d-99d2-8b50b4a2e9b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 09:52:57.005421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writer thread running {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 09:52:57.235434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3475b-a62d-469d-99d2-8b50b4a2e9b6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:52:57.239692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bff5f-09eb-4b2e-bb65-1281a06171f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:52:57.240347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bff5f-09eb-4b2e-bb65-1281a06171f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:52:57.240636 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bff5f-09eb-4b2e-bb65-1281a06171f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:52:57.240916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bff5f-09eb-4b2e-bb65-1281a06171f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:52:57.249865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bff5f-09eb-4b2e-bb65-1281a06171f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:52:57.303976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1f7bff5f-09eb-4b2e-bb65-1281a06171f2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 09:52:57.304328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bff5f-09eb-4b2e-bb65-1281a06171f2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:52:57.315124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jun 2 09:52:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:52:57.321178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02059b-75e0-46e9-a05e-3a2d679326a7 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:52:57.335412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02059b-75e0-46e9-a05e-3a2d679326a7 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:52:57.339952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13670c-f8b3-4c10-9af3-e678d1e590e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:52:57.341062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13670c-f8b3-4c10-9af3-e678d1e590e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:52:57.341346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13670c-f8b3-4c10-9af3-e678d1e590e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:52:57.341621 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13670c-f8b3-4c10-9af3-e678d1e590e6 admin admin] PATH_INFO: `/v3/projects/76cf5bbc77b94e4aad5326febc250cf3` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:52:57.343143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13670c-f8b3-4c10-9af3-e678d1e590e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=76cf5bbc77b94e4aad5326febc250cf3)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:52:57.394953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2d13670c-f8b3-4c10-9af3-e678d1e590e6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 09:52:57.395298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13670c-f8b3-4c10-9af3-e678d1e590e6 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:52:57.399930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jun 2 09:52:57 2022] GET /identity/v3/projects/76cf5bbc77b94e4aad5326febc250cf3 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:52:59.660662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fce28-256c-4ea5-8bba-1b477d051fe6 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:52:59.661198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fce28-256c-4ea5-8bba-1b477d051fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:52:59.661198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fce28-256c-4ea5-8bba-1b477d051fe6 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:52:59.665263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:52:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:52:59.670963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649dad-db86-485e-aeec-aca13386ca81 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:52:59.671334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649dad-db86-485e-aeec-aca13386ca81 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:52:59.671534 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55649dad-db86-485e-aeec-aca13386ca81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:52:59.693787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-55649dad-db86-485e-aeec-aca13386ca81 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:52:59.696307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-55649dad-db86-485e-aeec-aca13386ca81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:52:59.705698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:52:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 09:52:59.728611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fce28-256c-4ea5-8bba-1b477d051fe6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:52:59.740821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fce28-256c-4ea5-8bba-1b477d051fe6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:52:59.744899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bdc8e-9821-47cc-a8fd-e34d0fb4df11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:52:59.745523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bdc8e-9821-47cc-a8fd-e34d0fb4df11 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:52:59.745806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bdc8e-9821-47cc-a8fd-e34d0fb4df11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:52:59.746080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bdc8e-9821-47cc-a8fd-e34d0fb4df11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:52:59.753657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bdc8e-9821-47cc-a8fd-e34d0fb4df11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:52:59.755390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bdc8e-9821-47cc-a8fd-e34d0fb4df11 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:52:59.764449 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jun 2 09:52:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 09:52:59.769722 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55649dad-db86-485e-aeec-aca13386ca81 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:52:59.779627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55649dad-db86-485e-aeec-aca13386ca81 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:52:59.783979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc233ed-0fde-4dde-a81e-4aeb63bb03a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:52:59.784837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc233ed-0fde-4dde-a81e-4aeb63bb03a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:52:59.785125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc233ed-0fde-4dde-a81e-4aeb63bb03a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:52:59.785404 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc233ed-0fde-4dde-a81e-4aeb63bb03a5 admin admin] PATH_INFO: `/v3/users/ac2534ecb2984be38b622993992d8d0d` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:52:59.786794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc233ed-0fde-4dde-a81e-4aeb63bb03a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=ac2534ecb2984be38b622993992d8d0d)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:52:59.788661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc233ed-0fde-4dde-a81e-4aeb63bb03a5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:52:59.790218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jun 2 09:52:59 2022] GET /identity/v3/users/ac2534ecb2984be38b622993992d8d0d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:02.076629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff0b01-f9f0-4bd9-ac7e-5630205c7853 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.077404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff0b01-f9f0-4bd9-ac7e-5630205c7853 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.077576 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff0b01-f9f0-4bd9-ac7e-5630205c7853 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.078998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:02.084288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4946138-fcf0-47c1-ae64-3a3b873b3e08 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.084682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4946138-fcf0-47c1-ae64-3a3b873b3e08 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.084978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4946138-fcf0-47c1-ae64-3a3b873b3e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.101875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b4946138-fcf0-47c1-ae64-3a3b873b3e08 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:02.103049 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b4946138-fcf0-47c1-ae64-3a3b873b3e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:02.147882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13f904-e910-4490-b6fa-afad4c246b02 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.148087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13f904-e910-4490-b6fa-afad4c246b02 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.148367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13f904-e910-4490-b6fa-afad4c246b02 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.149719 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:02.155256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d9796-a724-436e-af18-a17af80f23d0 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.155552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d9796-a724-436e-af18-a17af80f23d0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.155866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d9796-a724-436e-af18-a17af80f23d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.183738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:02.196479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG passlib.handlers.bcrypt [None req-182d9796-a724-436e-af18-a17af80f23d0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80299) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 09:53:02.196925 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG passlib.handlers.bcrypt [None req-182d9796-a724-436e-af18-a17af80f23d0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80299) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 09:53:02.208742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4946138-fcf0-47c1-ae64-3a3b873b3e08 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:02.231642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:02.243825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-182d9796-a724-436e-af18-a17af80f23d0 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:02.246127 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-182d9796-a724-436e-af18-a17af80f23d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:02.312651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4946138-fcf0-47c1-ae64-3a3b873b3e08 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:02.344746 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:02.348639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e77f17-3dd3-4336-81e6-6502895800bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:02.349444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e77f17-3dd3-4336-81e6-6502895800bb None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.349731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e77f17-3dd3-4336-81e6-6502895800bb None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.350013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e77f17-3dd3-4336-81e6-6502895800bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.362209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e77f17-3dd3-4336-81e6-6502895800bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:02.367435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d9796-a724-436e-af18-a17af80f23d0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-12e77f17-3dd3-4336-81e6-6502895800bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:02.373711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:02.374884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:02.375903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:02.380558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e77f17-3dd3-4336-81e6-6502895800bb None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:02.460267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:02.467981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d9796-a724-436e-af18-a17af80f23d0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:02.472879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:02.477909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e77f17-3dd3-4336-81e6-6502895800bb None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:02.505490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec318c-27a3-4ae9-9b5e-d2688b72ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:02.506388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec318c-27a3-4ae9-9b5e-d2688b72ad75 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.506881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec318c-27a3-4ae9-9b5e-d2688b72ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.507170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec318c-27a3-4ae9-9b5e-d2688b72ad75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.512240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139dd35-76fc-4dc4-be08-11eafcc3d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:02.512901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139dd35-76fc-4dc4-be08-11eafcc3d40c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.513181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139dd35-76fc-4dc4-be08-11eafcc3d40c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.513454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139dd35-76fc-4dc4-be08-11eafcc3d40c None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.514204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139dd35-76fc-4dc4-be08-11eafcc3d40c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:02.514516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139dd35-76fc-4dc4-be08-11eafcc3d40c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:02.515917 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139dd35-76fc-4dc4-be08-11eafcc3d40c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:02.529184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:02.534733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139dd35-76fc-4dc4-be08-11eafcc3d40c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:02.575338 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec318c-27a3-4ae9-9b5e-d2688b72ad75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:02.576909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec318c-27a3-4ae9-9b5e-d2688b72ad75 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:02.633334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139dd35-76fc-4dc4-be08-11eafcc3d40c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:02.667157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90aa40-efb8-4c23-bb31-64ffc2d43afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:02.668066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90aa40-efb8-4c23-bb31-64ffc2d43afa None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.668475 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90aa40-efb8-4c23-bb31-64ffc2d43afa None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.668755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90aa40-efb8-4c23-bb31-64ffc2d43afa None admin] PATH_INFO: `/v3/users/ac2534ecb2984be38b622993992d8d0d` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.669976 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90aa40-efb8-4c23-bb31-64ffc2d43afa None admin] RBAC: Authorizing `identity:get_user(user_id=ac2534ecb2984be38b622993992d8d0d)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:02.671440 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90aa40-efb8-4c23-bb31-64ffc2d43afa None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:02.673085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 9/16] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:02 2022] GET /identity/v3/users/ac2534ecb2984be38b622993992d8d0d => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:02.676550 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 8/17] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:53:02.678246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90aa40-efb8-4c23-bb31-64ffc2d43afa None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:02.682191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec318c-27a3-4ae9-9b5e-d2688b72ad75 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:02.686098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:02.694188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:02.779229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90aa40-efb8-4c23-bb31-64ffc2d43afa None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:02.786396 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec318c-27a3-4ae9-9b5e-d2688b72ad75 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:02.813395 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d943d0-55ae-482c-98a8-424bd41df6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:02.814198 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d943d0-55ae-482c-98a8-424bd41df6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.814490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d943d0-55ae-482c-98a8-424bd41df6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.814771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d943d0-55ae-482c-98a8-424bd41df6d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.815992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d943d0-55ae-482c-98a8-424bd41df6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:02.817448 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d943d0-55ae-482c-98a8-424bd41df6d3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:02.819052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:02.819391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc889fd-c5d4-4502-9e5d-be8415553503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:02.820210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc889fd-c5d4-4502-9e5d-be8415553503 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.820496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc889fd-c5d4-4502-9e5d-be8415553503 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.820771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc889fd-c5d4-4502-9e5d-be8415553503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.824728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d943d0-55ae-482c-98a8-424bd41df6d3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:02.839242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc889fd-c5d4-4502-9e5d-be8415553503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:02.840746 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc889fd-c5d4-4502-9e5d-be8415553503 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-dfc889fd-c5d4-4502-9e5d-be8415553503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:53:02.861972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:02.862997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:02.864033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:53:02.864033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:53:02.864033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:53:02.864033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:02.865655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:02.872050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc889fd-c5d4-4502-9e5d-be8415553503 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:02.909284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:02.928200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:02.928872 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d943d0-55ae-482c-98a8-424bd41df6d3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:02.963837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce402be-c990-4879-8361-13ddd89ae65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:02.964588 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce402be-c990-4879-8361-13ddd89ae65b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:02.964874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce402be-c990-4879-8361-13ddd89ae65b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:02.965151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce402be-c990-4879-8361-13ddd89ae65b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:02.965979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce402be-c990-4879-8361-13ddd89ae65b None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.domain.id=default, user.id=ac2534ecb2984be38b622993992d8d0d) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:02.966288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce402be-c990-4879-8361-13ddd89ae65b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:02.967758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce402be-c990-4879-8361-13ddd89ae65b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:02.971638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc889fd-c5d4-4502-9e5d-be8415553503 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:02.974714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Jun 2 09:53:02 2022] GET /identity/v3/role_assignments?user.id=ac2534ecb2984be38b622993992d8d0d&scope.domain.id=default&role.id=918b179f19b6437493eabe5394fa9af0 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:03.008496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a87a04-6e44-4e03-8918-40d701dc2b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:03.009199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87a04-6e44-4e03-8918-40d701dc2b76 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:03.009487 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87a04-6e44-4e03-8918-40d701dc2b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:03.009770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a87a04-6e44-4e03-8918-40d701dc2b76 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:03.011293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a87a04-6e44-4e03-8918-40d701dc2b76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:03.011907 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a87a04-6e44-4e03-8918-40d701dc2b76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:03.013398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a87a04-6e44-4e03-8918-40d701dc2b76 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:03.033580 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:05.662174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df582fbb-4bfe-48ba-b584-bca0cc6ac0b9 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:05.663209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df582fbb-4bfe-48ba-b584-bca0cc6ac0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:05.663761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df582fbb-4bfe-48ba-b584-bca0cc6ac0b9 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:05.665321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:05.671739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3c153-2e33-4476-82e3-28aa6ace520e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:05.672697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3c153-2e33-4476-82e3-28aa6ace520e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:05.673207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3c153-2e33-4476-82e3-28aa6ace520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:05.700810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-24a3c153-2e33-4476-82e3-28aa6ace520e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:05.702414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-24a3c153-2e33-4476-82e3-28aa6ace520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:05.787997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:05.817650 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df582fbb-4bfe-48ba-b584-bca0cc6ac0b9 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:05.827396 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61b15-2c86-44ea-be17-a6b270443cde None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:05.828059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61b15-2c86-44ea-be17-a6b270443cde None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:05.828555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61b15-2c86-44ea-be17-a6b270443cde None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:05.830130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:05.837551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8ad5c-4f48-439a-b6ac-d9c8ba62898c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:05.838078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8ad5c-4f48-439a-b6ac-d9c8ba62898c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:05.839191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8ad5c-4f48-439a-b6ac-d9c8ba62898c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:05.872614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-06f8ad5c-4f48-439a-b6ac-d9c8ba62898c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:05.874046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-06f8ad5c-4f48-439a-b6ac-d9c8ba62898c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:05.967699 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:06.025560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 13/25] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:06.033233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df582fbb-4bfe-48ba-b584-bca0cc6ac0b9 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:06.071040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8ad5c-4f48-439a-b6ac-d9c8ba62898c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:06.104473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928da00-731d-4073-ad5d-257ea6aed7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:06.105588 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928da00-731d-4073-ad5d-257ea6aed7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:06.106078 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928da00-731d-4073-ad5d-257ea6aed7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:06.106538 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928da00-731d-4073-ad5d-257ea6aed7d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:06.133638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928da00-731d-4073-ad5d-257ea6aed7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-4928da00-731d-4073-ad5d-257ea6aed7d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:06.157079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:06.158014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:06.158842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:06.161010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 13/26] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:06.167607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928da00-731d-4073-ad5d-257ea6aed7d2 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:06.174388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:06.266846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8ad5c-4f48-439a-b6ac-d9c8ba62898c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:06.307218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928da00-731d-4073-ad5d-257ea6aed7d2 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:06.314732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc9726-866a-44cd-b423-b2643dbb5908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:06.315543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc9726-866a-44cd-b423-b2643dbb5908 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:06.315848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc9726-866a-44cd-b423-b2643dbb5908 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:06.316120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc9726-866a-44cd-b423-b2643dbb5908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:06.337923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc9726-866a-44cd-b423-b2643dbb5908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:06.340031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc9726-866a-44cd-b423-b2643dbb5908 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:06.344819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc05956-6060-47dd-a004-1ab048cde7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:06.345998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc05956-6060-47dd-a004-1ab048cde7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:06.346497 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc05956-6060-47dd-a004-1ab048cde7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:06.346997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc05956-6060-47dd-a004-1ab048cde7e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:06.348057 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc05956-6060-47dd-a004-1ab048cde7e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:06.348696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc05956-6060-47dd-a004-1ab048cde7e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:06.350339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc05956-6060-47dd-a004-1ab048cde7e7 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:06.360997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 14/27] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:06.362648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2948f8-9971-4c7c-b447-9321133b0b07 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:06.363159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2948f8-9971-4c7c-b447-9321133b0b07 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:06.363797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2948f8-9971-4c7c-b447-9321133b0b07 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:06.365233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 15/28] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:06.366820 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142ce2-9bc0-4f25-a7a8-d0ee0c054873 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:06.367347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142ce2-9bc0-4f25-a7a8-d0ee0c054873 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:06.367881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142ce2-9bc0-4f25-a7a8-d0ee0c054873 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:06.369400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 16/29] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:06.370421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99142ce2-9bc0-4f25-a7a8-d0ee0c054873 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-34bc9726-866a-44cd-b423-b2643dbb5908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:53:06.375148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:06.376326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:06.377128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:53:06.377128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:53:06.377128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:53:06.377128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:06.377128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 14/30] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:06.377128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf6df6-58f1-4e01-b74e-371ce3f4579f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:06.377829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf6df6-58f1-4e01-b74e-371ce3f4579f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:06.377829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf6df6-58f1-4e01-b74e-371ce3f4579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:06.399176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-05bf6df6-58f1-4e01-b74e-371ce3f4579f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:06.400497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-05bf6df6-58f1-4e01-b74e-371ce3f4579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:06.426256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:06.447521 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:06.472937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 15/31] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:06.474327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c9ef3-ef7e-401f-9680-b8c9a26a7444 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:06.474621 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c9ef3-ef7e-401f-9680-b8c9a26a7444 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:06.474897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c9ef3-ef7e-401f-9680-b8c9a26a7444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:06.487034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99142ce2-9bc0-4f25-a7a8-d0ee0c054873 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:06.491615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5e9c9ef3-ef7e-401f-9680-b8c9a26a7444 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:06.492804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5e9c9ef3-ef7e-401f-9680-b8c9a26a7444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:06.528405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142157f9-6604-4de8-8b5d-621f2cf80093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:06.529603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142157f9-6604-4de8-8b5d-621f2cf80093 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:06.530084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142157f9-6604-4de8-8b5d-621f2cf80093 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:06.530802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142157f9-6604-4de8-8b5d-621f2cf80093 None admin] PATH_INFO: `/v3/users/ac2534ecb2984be38b622993992d8d0d` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:06.533178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142157f9-6604-4de8-8b5d-621f2cf80093 None admin] RBAC: Authorizing `identity:get_user(user_id=ac2534ecb2984be38b622993992d8d0d)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:06.534866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142157f9-6604-4de8-8b5d-621f2cf80093 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:06.537656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 17/32] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:06 2022] GET /identity/v3/users/ac2534ecb2984be38b622993992d8d0d => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:06.538703 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142157f9-6604-4de8-8b5d-621f2cf80093 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:06.574268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 16/33] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:06.576231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c9ef3-ef7e-401f-9680-b8c9a26a7444 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:06.651559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142157f9-6604-4de8-8b5d-621f2cf80093 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:06.696797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:06.699923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d90ef4-e213-4a6d-9f1b-22d5d604dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:06.701733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90ef4-e213-4a6d-9f1b-22d5d604dc7a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:06.702243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90ef4-e213-4a6d-9f1b-22d5d604dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:06.702883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d90ef4-e213-4a6d-9f1b-22d5d604dc7a None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:06.704504 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d90ef4-e213-4a6d-9f1b-22d5d604dc7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:06.710424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d90ef4-e213-4a6d-9f1b-22d5d604dc7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:06.710424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d90ef4-e213-4a6d-9f1b-22d5d604dc7a None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:06.710610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c9ef3-ef7e-401f-9680-b8c9a26a7444 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:06.710700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:06.730921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 18/34] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:06.735564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d90ef4-e213-4a6d-9f1b-22d5d604dc7a None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:06.753596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f316b-78bb-4db6-8bee-4b1d24e9e2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:06.754562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f316b-78bb-4db6-8bee-4b1d24e9e2e4 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:06.755089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f316b-78bb-4db6-8bee-4b1d24e9e2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:06.755540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f316b-78bb-4db6-8bee-4b1d24e9e2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:06.756572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f316b-78bb-4db6-8bee-4b1d24e9e2e4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:06.758134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f316b-78bb-4db6-8bee-4b1d24e9e2e4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:06.849277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d90ef4-e213-4a6d-9f1b-22d5d604dc7a None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:06.891514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac2bf9-246d-428b-8a45-8fb3dd0ac722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:06.893403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac2bf9-246d-428b-8a45-8fb3dd0ac722 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:06.893403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac2bf9-246d-428b-8a45-8fb3dd0ac722 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:06.893403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac2bf9-246d-428b-8a45-8fb3dd0ac722 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:06.894464 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac2bf9-246d-428b-8a45-8fb3dd0ac722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:06.896000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac2bf9-246d-428b-8a45-8fb3dd0ac722 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:06.898149 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 19/35] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:06.899092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac2bf9-246d-428b-8a45-8fb3dd0ac722 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:06.965715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:06.975794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 17/36] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jun 2 09:53:06 2022] POST /identity/v3/roles => generated 225 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:06.977222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f316b-78bb-4db6-8bee-4b1d24e9e2e4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:07.033632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac2bf9-246d-428b-8a45-8fb3dd0ac722 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:07.115071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c70646-4fe4-4f5e-bbfb-c0428610f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:07.117411 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c70646-4fe4-4f5e-bbfb-c0428610f340 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:07.118585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c70646-4fe4-4f5e-bbfb-c0428610f340 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:07.119339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c70646-4fe4-4f5e-bbfb-c0428610f340 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:07.121786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c70646-4fe4-4f5e-bbfb-c0428610f340 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:07.123543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c70646-4fe4-4f5e-bbfb-c0428610f340 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:07.167959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f316b-78bb-4db6-8bee-4b1d24e9e2e4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:07.205831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0de96-3c90-4732-a383-d3f369c7b06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:07.206506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0de96-3c90-4732-a383-d3f369c7b06e None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:07.206792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0de96-3c90-4732-a383-d3f369c7b06e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:07.207072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0de96-3c90-4732-a383-d3f369c7b06e None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:07.208128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0de96-3c90-4732-a383-d3f369c7b06e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:07.209899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0de96-3c90-4732-a383-d3f369c7b06e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:07.296174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:07.302595 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:53:06 2022] POST /identity/v3/projects => generated 301 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:07.303794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0de96-3c90-4732-a383-d3f369c7b06e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:07.344357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 20/38] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jun 2 09:53:06 2022] POST /identity/v3/roles => generated 219 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:07.346174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967489a8-1c9d-405e-b0b5-b5e8e47d7eb8 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:07.346478 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967489a8-1c9d-405e-b0b5-b5e8e47d7eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:07.346768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967489a8-1c9d-405e-b0b5-b5e8e47d7eb8 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:07.351786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 21/39] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:07.351786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f2270-f57e-45aa-8514-5e9842931e54 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:07.351786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f2270-f57e-45aa-8514-5e9842931e54 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:07.351786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f2270-f57e-45aa-8514-5e9842931e54 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:07.351786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 22/40] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:07.358685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264ab54-94c7-42e7-8072-7fb2aba0fcc6 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:07.358996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264ab54-94c7-42e7-8072-7fb2aba0fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:07.359273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264ab54-94c7-42e7-8072-7fb2aba0fcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:07.379889 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-6264ab54-94c7-42e7-8072-7fb2aba0fcc6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:07.381493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6264ab54-94c7-42e7-8072-7fb2aba0fcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:07.471019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0de96-3c90-4732-a383-d3f369c7b06e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:07.484259 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 23/41] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:07.487662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318cdd-a738-4827-8038-0e9afe2c5ff4 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:07.488060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318cdd-a738-4827-8038-0e9afe2c5ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:07.488350 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45318cdd-a738-4827-8038-0e9afe2c5ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:07.515208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-45318cdd-a738-4827-8038-0e9afe2c5ff4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:07.516586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-45318cdd-a738-4827-8038-0e9afe2c5ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:07.535838 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f644a8-31b2-4193-a579-72e729a83b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:07.537370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f644a8-31b2-4193-a579-72e729a83b24 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:07.538045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f644a8-31b2-4193-a579-72e729a83b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:07.538540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f644a8-31b2-4193-a579-72e729a83b24 None admin] PATH_INFO: `/v3/domains/default/users/ac2534ecb2984be38b622993992d8d0d/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:07.542218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f644a8-31b2-4193-a579-72e729a83b24 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ac2534ecb2984be38b622993992d8d0d, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:07.544385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f644a8-31b2-4193-a579-72e729a83b24 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:07.575188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:07.597573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 24/42] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:07.598417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45318cdd-a738-4827-8038-0e9afe2c5ff4 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:07.651361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 19/43] 10.222.0.48 () {58 vars in 1361 bytes} [Thu Jun 2 09:53:07 2022] PUT /identity/v3/domains/default/users/ac2534ecb2984be38b622993992d8d0d/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:07.652137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f644a8-31b2-4193-a579-72e729a83b24 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:07.706605 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45318cdd-a738-4827-8038-0e9afe2c5ff4 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:07.722403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:07.748430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357c2a7-68c9-48d1-976f-9b59c196c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:07.749125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357c2a7-68c9-48d1-976f-9b59c196c703 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:07.749410 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357c2a7-68c9-48d1-976f-9b59c196c703 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:07.749694 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357c2a7-68c9-48d1-976f-9b59c196c703 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:07.750458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357c2a7-68c9-48d1-976f-9b59c196c703 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:07.752129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357c2a7-68c9-48d1-976f-9b59c196c703 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:07.771132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f644a8-31b2-4193-a579-72e729a83b24 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:07.808868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7a9ce-105e-4895-9fa9-6fa702574799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:07.809728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7a9ce-105e-4895-9fa9-6fa702574799 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:07.809954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7a9ce-105e-4895-9fa9-6fa702574799 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:07.810235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7a9ce-105e-4895-9fa9-6fa702574799 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:07.811440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7a9ce-105e-4895-9fa9-6fa702574799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:07.813119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7a9ce-105e-4895-9fa9-6fa702574799 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:07.814980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 20/44] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:07.827834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 25/45] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jun 2 09:53:07 2022] POST /identity/v3/roles => generated 223 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:07.828036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7a9ce-105e-4895-9fa9-6fa702574799 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:07.954964 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7a9ce-105e-4895-9fa9-6fa702574799 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:07.984029 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:07.993108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd2964-22b9-4359-be50-7e9171528df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:07.998128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2964-22b9-4359-be50-7e9171528df5 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:07.998128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2964-22b9-4359-be50-7e9171528df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:07.998128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd2964-22b9-4359-be50-7e9171528df5 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:07.998128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd2964-22b9-4359-be50-7e9171528df5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:07.998128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd2964-22b9-4359-be50-7e9171528df5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:08.076278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 21/46] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:53:07 2022] POST /identity/v3/projects => generated 312 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:09.907840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c23c-48fd-4871-a523-a9b70171e094 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:09.908341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c23c-48fd-4871-a523-a9b70171e094 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:09.908522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665c23c-48fd-4871-a523-a9b70171e094 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:09.909790 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 26/47] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:09.915267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a620-fa44-4ee7-a8bc-b2bfb8ee835a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:09.915703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a620-fa44-4ee7-a8bc-b2bfb8ee835a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:09.915871 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076a620-fa44-4ee7-a8bc-b2bfb8ee835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:09.933166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9076a620-fa44-4ee7-a8bc-b2bfb8ee835a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:09.934704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9076a620-fa44-4ee7-a8bc-b2bfb8ee835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:10.004241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 22/48] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:10.029179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665c23c-48fd-4871-a523-a9b70171e094 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:10.073098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:10.128533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665c23c-48fd-4871-a523-a9b70171e094 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:10.161529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fbb07-7a8d-47f8-976e-53ebb9ed41c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:10.162320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fbb07-7a8d-47f8-976e-53ebb9ed41c2 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:10.162608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fbb07-7a8d-47f8-976e-53ebb9ed41c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:10.162888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fbb07-7a8d-47f8-976e-53ebb9ed41c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:10.173507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fbb07-7a8d-47f8-976e-53ebb9ed41c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-415fbb07-7a8d-47f8-976e-53ebb9ed41c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:10.181082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:10.182106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:10.182905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 27/49] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:10.189551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076a620-fa44-4ee7-a8bc-b2bfb8ee835a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:10.287437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076a620-fa44-4ee7-a8bc-b2bfb8ee835a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:10.298198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:10.320617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fbfe6-224f-4c68-bbb1-f4bdcde3d168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:10.321287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbfe6-224f-4c68-bbb1-f4bdcde3d168 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:10.321582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbfe6-224f-4c68-bbb1-f4bdcde3d168 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:10.321866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbfe6-224f-4c68-bbb1-f4bdcde3d168 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:10.323150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fbfe6-224f-4c68-bbb1-f4bdcde3d168 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:10.323609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fbfe6-224f-4c68-bbb1-f4bdcde3d168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:10.325138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fbfe6-224f-4c68-bbb1-f4bdcde3d168 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:10.337758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 23/50] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:10.343288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fbb07-7a8d-47f8-976e-53ebb9ed41c2 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:10.343894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6cb1e-0a04-4eb6-8f87-1f03cc19e517 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:10.344190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6cb1e-0a04-4eb6-8f87-1f03cc19e517 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:10.344474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6cb1e-0a04-4eb6-8f87-1f03cc19e517 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:10.345797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 24/51] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:10.350764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df08d8b-3402-4ac1-a7b8-e1f121465e4d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:10.351051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df08d8b-3402-4ac1-a7b8-e1f121465e4d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:10.351331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df08d8b-3402-4ac1-a7b8-e1f121465e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:10.368394 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7df08d8b-3402-4ac1-a7b8-e1f121465e4d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:10.370145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7df08d8b-3402-4ac1-a7b8-e1f121465e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:10.436782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 25/52] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:10.445119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fbb07-7a8d-47f8-976e-53ebb9ed41c2 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:10.446614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:10.459445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df08d8b-3402-4ac1-a7b8-e1f121465e4d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:10.478128 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ea48a-41ab-46f7-b7f6-f273a0837b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:10.479695 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ea48a-41ab-46f7-b7f6-f273a0837b04 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:10.479980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ea48a-41ab-46f7-b7f6-f273a0837b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:10.480258 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ea48a-41ab-46f7-b7f6-f273a0837b04 None admin] PATH_INFO: `/v3/users/ac2534ecb2984be38b622993992d8d0d` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:10.481455 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ea48a-41ab-46f7-b7f6-f273a0837b04 None admin] RBAC: Authorizing `identity:get_user(user_id=ac2534ecb2984be38b622993992d8d0d)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:10.482904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ea48a-41ab-46f7-b7f6-f273a0837b04 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:10.484554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 28/53] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:10 2022] GET /identity/v3/users/ac2534ecb2984be38b622993992d8d0d => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:10.489872 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ea48a-41ab-46f7-b7f6-f273a0837b04 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:10.559075 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df08d8b-3402-4ac1-a7b8-e1f121465e4d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:10.560610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:10.586025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ea48a-41ab-46f7-b7f6-f273a0837b04 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:10.594082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af011-d05c-4bcf-a2ec-1796799fb209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:10.594884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af011-d05c-4bcf-a2ec-1796799fb209 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:10.595179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af011-d05c-4bcf-a2ec-1796799fb209 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:10.595460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7af011-d05c-4bcf-a2ec-1796799fb209 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:10.596701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7af011-d05c-4bcf-a2ec-1796799fb209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:10.598175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7af011-d05c-4bcf-a2ec-1796799fb209 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:10.599844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 26/54] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:10.605799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af011-d05c-4bcf-a2ec-1796799fb209 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:10.618980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b43844-f392-4eb0-a6e0-d1b5fa1f234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:10.620320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b43844-f392-4eb0-a6e0-d1b5fa1f234e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:10.620608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b43844-f392-4eb0-a6e0-d1b5fa1f234e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:10.620888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b43844-f392-4eb0-a6e0-d1b5fa1f234e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:10.622116 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b43844-f392-4eb0-a6e0-d1b5fa1f234e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:10.623599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b43844-f392-4eb0-a6e0-d1b5fa1f234e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:10.625224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 29/55] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:10.630757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b43844-f392-4eb0-a6e0-d1b5fa1f234e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:10.670091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:10.711536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7af011-d05c-4bcf-a2ec-1796799fb209 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:10.731243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b43844-f392-4eb0-a6e0-d1b5fa1f234e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:10.747921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36aba3-f532-414b-a320-06d50a35cb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:10.748586 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36aba3-f532-414b-a320-06d50a35cb41 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:10.748879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36aba3-f532-414b-a320-06d50a35cb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:10.749163 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36aba3-f532-414b-a320-06d50a35cb41 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:10.749880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36aba3-f532-414b-a320-06d50a35cb41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:10.751355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36aba3-f532-414b-a320-06d50a35cb41 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:10.763870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d483c-5911-48ec-be2e-5e9181191f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:10.764578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d483c-5911-48ec-be2e-5e9181191f96 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:10.764908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d483c-5911-48ec-be2e-5e9181191f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:10.765198 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d483c-5911-48ec-be2e-5e9181191f96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:10.766114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d483c-5911-48ec-be2e-5e9181191f96 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.domain.id=default, user.id=ac2534ecb2984be38b622993992d8d0d) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:10.766346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d483c-5911-48ec-be2e-5e9181191f96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:10.767786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d483c-5911-48ec-be2e-5e9181191f96 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:10.773539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 30/56] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Jun 2 09:53:10 2022] GET /identity/v3/role_assignments?user.id=ac2534ecb2984be38b622993992d8d0d&scope.domain.id=default&role.id=918b179f19b6437493eabe5394fa9af0 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:10.839267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 27/57] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Jun 2 09:53:10 2022] POST /identity/v3/projects => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:53:13.141611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e364b-2b6c-4092-904b-d99180e30479 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:13.142104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e364b-2b6c-4092-904b-d99180e30479 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:13.142104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e364b-2b6c-4092-904b-d99180e30479 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:13.143481 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:13.148763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4e846-6171-4eb5-beb0-db6ab55e9f5d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:13.149166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4e846-6171-4eb5-beb0-db6ab55e9f5d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:13.149344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4e846-6171-4eb5-beb0-db6ab55e9f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:13.167057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-92f4e846-6171-4eb5-beb0-db6ab55e9f5d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:13.168291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-92f4e846-6171-4eb5-beb0-db6ab55e9f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:13.185207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:13.234225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:13.258673 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e364b-2b6c-4092-904b-d99180e30479 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:13.357470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e364b-2b6c-4092-904b-d99180e30479 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:13.358949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:13.390627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac989e6-7926-477d-8ae8-ce287be91570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:13.391409 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac989e6-7926-477d-8ae8-ce287be91570 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:13.391775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac989e6-7926-477d-8ae8-ce287be91570 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:13.392002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac989e6-7926-477d-8ae8-ce287be91570 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:13.393162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac989e6-7926-477d-8ae8-ce287be91570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:13.394592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac989e6-7926-477d-8ae8-ce287be91570 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:13.396213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:13.402910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4e846-6171-4eb5-beb0-db6ab55e9f5d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:13.499963 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4e846-6171-4eb5-beb0-db6ab55e9f5d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:13.533349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732feea-ed7c-4ec6-af23-86ef0150b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:13.534001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732feea-ed7c-4ec6-af23-86ef0150b735 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:13.534292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732feea-ed7c-4ec6-af23-86ef0150b735 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:13.534577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732feea-ed7c-4ec6-af23-86ef0150b735 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:13.535306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732feea-ed7c-4ec6-af23-86ef0150b735 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:13.536785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732feea-ed7c-4ec6-af23-86ef0150b735 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:13.636349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:13 2022] POST /identity/v3/users => generated 275 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:16.968165 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5ee9-f243-4bb0-9b29-0ce8493a8dc8 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:16.969178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5ee9-f243-4bb0-9b29-0ce8493a8dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:16.969709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5ee9-f243-4bb0-9b29-0ce8493a8dc8 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:16.971312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:16.976600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdf3ba-4631-41e5-8bdb-cee9b223383d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:16.977401 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdf3ba-4631-41e5-8bdb-cee9b223383d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:16.977908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdf3ba-4631-41e5-8bdb-cee9b223383d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:16.997210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f9cdf3ba-4631-41e5-8bdb-cee9b223383d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:16.998714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f9cdf3ba-4631-41e5-8bdb-cee9b223383d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:17.001042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:17.091543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 30/63] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:17.127913 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5ee9-f243-4bb0-9b29-0ce8493a8dc8 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.137978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c7cd-a0df-4eaa-986c-98dc8655c120 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.138563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c7cd-a0df-4eaa-986c-98dc8655c120 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.139065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c7cd-a0df-4eaa-986c-98dc8655c120 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.140995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 31/64] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:17.147220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900f316-968f-4069-a3c8-03a0c8823430 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.148037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900f316-968f-4069-a3c8-03a0c8823430 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.148524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900f316-968f-4069-a3c8-03a0c8823430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.179029 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5900f316-968f-4069-a3c8-03a0c8823430 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:17.182353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5900f316-968f-4069-a3c8-03a0c8823430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:17.314338 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5ee9-f243-4bb0-9b29-0ce8493a8dc8 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.342957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 32/65] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:17.351738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a01b0-1cbd-470f-85fe-1c51be75f88d None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.351738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a01b0-1cbd-470f-85fe-1c51be75f88d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.351738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a01b0-1cbd-470f-85fe-1c51be75f88d None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.351738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 33/66] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:17.357363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802d215-322c-47d8-9a2b-524aac6427c5 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.357659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802d215-322c-47d8-9a2b-524aac6427c5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.357946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802d215-322c-47d8-9a2b-524aac6427c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.381042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6e3b-b08c-47a7-960a-f349dd3aabcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.382180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6e3b-b08c-47a7-960a-f349dd3aabcf None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.382662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6e3b-b08c-47a7-960a-f349dd3aabcf None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.383147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6e3b-b08c-47a7-960a-f349dd3aabcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.384341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d802d215-322c-47d8-9a2b-524aac6427c5 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:17.386055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d802d215-322c-47d8-9a2b-524aac6427c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:17.397169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e6e3b-b08c-47a7-960a-f349dd3aabcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-0f0e6e3b-b08c-47a7-960a-f349dd3aabcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:17.409063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:17.409951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:17.410724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:17.413040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 34/67] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:17.414213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6e3b-b08c-47a7-960a-f349dd3aabcf None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.455086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:17.462279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:17.469137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 34/68] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:17.470113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802d215-322c-47d8-9a2b-524aac6427c5 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.545991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6e3b-b08c-47a7-960a-f349dd3aabcf None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.582248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61aa7a-b667-4efd-820d-5238b0f18da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.583429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61aa7a-b667-4efd-820d-5238b0f18da6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.583887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61aa7a-b667-4efd-820d-5238b0f18da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.584306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61aa7a-b667-4efd-820d-5238b0f18da6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.595705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61aa7a-b667-4efd-820d-5238b0f18da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-8c61aa7a-b667-4efd-820d-5238b0f18da6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:17.604956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:17.605853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 35/69] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:17.607171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61aa7a-b667-4efd-820d-5238b0f18da6 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.611269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802d215-322c-47d8-9a2b-524aac6427c5 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.649085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34045a0b-be45-43bf-a8e0-0221115f73e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.650982 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34045a0b-be45-43bf-a8e0-0221115f73e1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.651267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34045a0b-be45-43bf-a8e0-0221115f73e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.651547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34045a0b-be45-43bf-a8e0-0221115f73e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.652603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34045a0b-be45-43bf-a8e0-0221115f73e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:17.652913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34045a0b-be45-43bf-a8e0-0221115f73e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:17.654410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34045a0b-be45-43bf-a8e0-0221115f73e1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:17.668556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 35/70] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:17.668556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c7012-a641-4a46-bb73-cf81967d5483 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.668556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c7012-a641-4a46-bb73-cf81967d5483 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.668556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c7012-a641-4a46-bb73-cf81967d5483 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.668556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 36/71] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:17.668556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c7012-a641-4a46-bb73-cf81967d5483 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.717591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:17.727358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61aa7a-b667-4efd-820d-5238b0f18da6 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.733440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:17.767109 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47fe36-a86f-42b3-87e4-3871c5aa997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.767949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47fe36-a86f-42b3-87e4-3871c5aa997d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.768241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47fe36-a86f-42b3-87e4-3871c5aa997d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.768531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47fe36-a86f-42b3-87e4-3871c5aa997d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.776210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c7012-a641-4a46-bb73-cf81967d5483 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.780389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47fe36-a86f-42b3-87e4-3871c5aa997d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-ee47fe36-a86f-42b3-87e4-3871c5aa997d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:17.788457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:17.789312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:17.790083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 36/72] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:17.790752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47fe36-a86f-42b3-87e4-3871c5aa997d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.814839 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f72c2e-bf89-4c7b-af31-ff6e29e4bc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.815515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72c2e-bf89-4c7b-af31-ff6e29e4bc72 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.815860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72c2e-bf89-4c7b-af31-ff6e29e4bc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.816141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f72c2e-bf89-4c7b-af31-ff6e29e4bc72 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.816895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f72c2e-bf89-4c7b-af31-ff6e29e4bc72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:17.817211 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f72c2e-bf89-4c7b-af31-ff6e29e4bc72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:17.818591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f72c2e-bf89-4c7b-af31-ff6e29e4bc72 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:17.827446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:17.828669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f898b-946b-4e4c-b249-deb2349d5d1c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.828951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f898b-946b-4e4c-b249-deb2349d5d1c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.829235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f898b-946b-4e4c-b249-deb2349d5d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.846485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-066f898b-946b-4e4c-b249-deb2349d5d1c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:17.847701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-066f898b-946b-4e4c-b249-deb2349d5d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:17.901594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47fe36-a86f-42b3-87e4-3871c5aa997d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:17.918677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 38/74] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:17.919525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f898b-946b-4e4c-b249-deb2349d5d1c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.936345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635aa8df-30ce-4258-9134-66b04fdeb643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:17.937225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aa8df-30ce-4258-9134-66b04fdeb643 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.937508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aa8df-30ce-4258-9134-66b04fdeb643 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.937788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635aa8df-30ce-4258-9134-66b04fdeb643 None admin] PATH_INFO: `/v3/users/f4c305238f3a4e6eabfcf2068197c2dd` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.952004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635aa8df-30ce-4258-9134-66b04fdeb643 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c305238f3a4e6eabfcf2068197c2dd)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:17.953494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635aa8df-30ce-4258-9134-66b04fdeb643 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:17.955329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/users/f4c305238f3a4e6eabfcf2068197c2dd => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:17.956547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c4ca2-395a-4ea7-b4ee-9a3a6a55321b None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:17.956847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c4ca2-395a-4ea7-b4ee-9a3a6a55321b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:17.957126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c4ca2-395a-4ea7-b4ee-9a3a6a55321b None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:17.958366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 38/76] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:17.959058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c4ca2-395a-4ea7-b4ee-9a3a6a55321b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:17.969491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:17.977317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:18.023238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f898b-946b-4e4c-b249-deb2349d5d1c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:18.056978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a81705-7dd6-4988-a82f-136b50f041eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:18.057652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81705-7dd6-4988-a82f-136b50f041eb None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.057938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81705-7dd6-4988-a82f-136b50f041eb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.058213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a81705-7dd6-4988-a82f-136b50f041eb None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.058957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a81705-7dd6-4988-a82f-136b50f041eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:18.059266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a81705-7dd6-4988-a82f-136b50f041eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:18.059543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c4ca2-395a-4ea7-b4ee-9a3a6a55321b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:18.060679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a81705-7dd6-4988-a82f-136b50f041eb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:18.069127 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 39/77] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:18.069903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a81705-7dd6-4988-a82f-136b50f041eb None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:18.094894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40791182-f7a6-42e5-92b0-422350de2c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:18.095798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40791182-f7a6-42e5-92b0-422350de2c9f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.096087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40791182-f7a6-42e5-92b0-422350de2c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.096370 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40791182-f7a6-42e5-92b0-422350de2c9f None admin] PATH_INFO: `/v3/users/f4c305238f3a4e6eabfcf2068197c2dd` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.097566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40791182-f7a6-42e5-92b0-422350de2c9f None admin] RBAC: Authorizing `identity:get_user(user_id=f4c305238f3a4e6eabfcf2068197c2dd)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:18.098999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40791182-f7a6-42e5-92b0-422350de2c9f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:18.100649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 39/78] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:17 2022] GET /identity/v3/users/f4c305238f3a4e6eabfcf2068197c2dd => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:18.101402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40791182-f7a6-42e5-92b0-422350de2c9f None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:18.167750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a81705-7dd6-4988-a82f-136b50f041eb None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:18.177002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:18.181037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:18.199701 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40791182-f7a6-42e5-92b0-422350de2c9f None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:18.201362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ae8ed-f0a1-4c97-b0cf-6c4109feb533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:18.202165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ae8ed-f0a1-4c97-b0cf-6c4109feb533 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.202450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ae8ed-f0a1-4c97-b0cf-6c4109feb533 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.202728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ae8ed-f0a1-4c97-b0cf-6c4109feb533 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.203941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ae8ed-f0a1-4c97-b0cf-6c4109feb533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:18.205397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ae8ed-f0a1-4c97-b0cf-6c4109feb533 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:18.207008 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 40/79] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:18.208159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968d000-96d9-4e44-837b-4907774e96e3 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.208445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968d000-96d9-4e44-837b-4907774e96e3 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.208721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968d000-96d9-4e44-837b-4907774e96e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.225227 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4968d000-96d9-4e44-837b-4907774e96e3 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:18.226503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4968d000-96d9-4e44-837b-4907774e96e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:18.233775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9080877-8a51-4627-91de-6e5a57051a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:18.234431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9080877-8a51-4627-91de-6e5a57051a3f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.234717 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9080877-8a51-4627-91de-6e5a57051a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.234994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9080877-8a51-4627-91de-6e5a57051a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.293823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 41/80] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:18.294661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968d000-96d9-4e44-837b-4907774e96e3 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:18.301630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9080877-8a51-4627-91de-6e5a57051a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:18.303085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9080877-8a51-4627-91de-6e5a57051a3f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:18.380529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:18.402809 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968d000-96d9-4e44-837b-4907774e96e3 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:18.403550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 40/81] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:18.404398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9080877-8a51-4627-91de-6e5a57051a3f None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:18.416666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:18.438096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e4f4e-09ff-411d-b22b-c87970d15813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:18.438974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4f4e-09ff-411d-b22b-c87970d15813 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.439271 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4f4e-09ff-411d-b22b-c87970d15813 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.439557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4f4e-09ff-411d-b22b-c87970d15813 None admin] PATH_INFO: `/v3/users/ac2534ecb2984be38b622993992d8d0d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.440800 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e4f4e-09ff-411d-b22b-c87970d15813 None admin] RBAC: Authorizing `identity:get_user(user_id=ac2534ecb2984be38b622993992d8d0d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:18.442655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e4f4e-09ff-411d-b22b-c87970d15813 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:18.448874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 42/82] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:18 2022] GET /identity/v3/users/ac2534ecb2984be38b622993992d8d0d => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:18.448874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e4f4e-09ff-411d-b22b-c87970d15813 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:18.501478 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9080877-8a51-4627-91de-6e5a57051a3f None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:18.534201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f98d8-9f5e-4853-be7e-7ea720417dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:18.534844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f98d8-9f5e-4853-be7e-7ea720417dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.535129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f98d8-9f5e-4853-be7e-7ea720417dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.535404 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f98d8-9f5e-4853-be7e-7ea720417dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.544214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e4f4e-09ff-411d-b22b-c87970d15813 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:18.578197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73529e94-c1a6-41cf-b578-6e32442fc06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:18.578668 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:18.578864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73529e94-c1a6-41cf-b578-6e32442fc06b None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.579153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73529e94-c1a6-41cf-b578-6e32442fc06b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.579439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73529e94-c1a6-41cf-b578-6e32442fc06b None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.580190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73529e94-c1a6-41cf-b578-6e32442fc06b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:18.581632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73529e94-c1a6-41cf-b578-6e32442fc06b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:18.599909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f98d8-9f5e-4853-be7e-7ea720417dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:18.601367 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f98d8-9f5e-4853-be7e-7ea720417dc8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:18.671645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 43/83] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:18 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:18.672484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73529e94-c1a6-41cf-b578-6e32442fc06b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:18.711897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 41/84] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:18.713039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f98d8-9f5e-4853-be7e-7ea720417dc8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:18.721113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:18.792544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73529e94-c1a6-41cf-b578-6e32442fc06b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:18.803637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:18.828906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5c12e-86ea-4123-bfb3-01144480a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:18.830048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5c12e-86ea-4123-bfb3-01144480a43a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.830337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5c12e-86ea-4123-bfb3-01144480a43a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.830615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5c12e-86ea-4123-bfb3-01144480a43a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.832931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f98d8-9f5e-4853-be7e-7ea720417dc8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:18.844131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe5c12e-86ea-4123-bfb3-01144480a43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-bbe5c12e-86ea-4123-bfb3-01144480a43a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:18.853633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:18.854783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:18.855822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:18.859783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 44/85] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:18.860743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5c12e-86ea-4123-bfb3-01144480a43a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:18.880113 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6786da-b28a-464b-af0e-e34f5eae0018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:18.881522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6786da-b28a-464b-af0e-e34f5eae0018 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:18.881522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6786da-b28a-464b-af0e-e34f5eae0018 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:18.881522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6786da-b28a-464b-af0e-e34f5eae0018 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:18.882702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6786da-b28a-464b-af0e-e34f5eae0018 None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:18.884923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6786da-b28a-464b-af0e-e34f5eae0018 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:18.886851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 42/86] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:18 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:18.887518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6786da-b28a-464b-af0e-e34f5eae0018 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:19.006902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:19.010916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6786da-b28a-464b-af0e-e34f5eae0018 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:19.016901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5c12e-86ea-4123-bfb3-01144480a43a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:19.058014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126c754-bbeb-4b79-beb4-8dcd8f77eff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:19.059169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126c754-bbeb-4b79-beb4-8dcd8f77eff1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:19.059463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126c754-bbeb-4b79-beb4-8dcd8f77eff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:19.059862 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126c754-bbeb-4b79-beb4-8dcd8f77eff1 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:19.061146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e027f-5a82-4f7a-ae29-9804eab06036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:19.061268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126c754-bbeb-4b79-beb4-8dcd8f77eff1 None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:19.061860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e027f-5a82-4f7a-ae29-9804eab06036 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:19.062150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e027f-5a82-4f7a-ae29-9804eab06036 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:19.062437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e027f-5a82-4f7a-ae29-9804eab06036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:19.062695 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126c754-bbeb-4b79-beb4-8dcd8f77eff1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:19.064870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 43/87] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:18 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:19.066025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126c754-bbeb-4b79-beb4-8dcd8f77eff1 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:19.116144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:19.184435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e027f-5a82-4f7a-ae29-9804eab06036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:19.186534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e027f-5a82-4f7a-ae29-9804eab06036 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:19.214200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126c754-bbeb-4b79-beb4-8dcd8f77eff1 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:19.258684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188e368-b4a6-4302-a84c-b82e4bdc47ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:19.260286 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188e368-b4a6-4302-a84c-b82e4bdc47ac None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:19.260844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188e368-b4a6-4302-a84c-b82e4bdc47ac None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:19.261263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188e368-b4a6-4302-a84c-b82e4bdc47ac None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:19.262302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188e368-b4a6-4302-a84c-b82e4bdc47ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:19.262770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188e368-b4a6-4302-a84c-b82e4bdc47ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:19.265122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188e368-b4a6-4302-a84c-b82e4bdc47ac None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:19.275727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 44/88] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:19.276794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188e368-b4a6-4302-a84c-b82e4bdc47ac None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:19.296617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:19.307700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 45/89] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:19.309121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e027f-5a82-4f7a-ae29-9804eab06036 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:19.380371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:19.414481 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188e368-b4a6-4302-a84c-b82e4bdc47ac None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:19.428802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e027f-5a82-4f7a-ae29-9804eab06036 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:19.458368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d7afe-7b38-4607-8fb4-a825341accd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:19.459051 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d7afe-7b38-4607-8fb4-a825341accd5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:19.459348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d7afe-7b38-4607-8fb4-a825341accd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:19.459905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d7afe-7b38-4607-8fb4-a825341accd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:19.461304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d7afe-7b38-4607-8fb4-a825341accd5 None admin] RBAC: Adding query filter params (role.id=67cb3b4802a642ae98a93929ca7b724c, scope.project.id=18750bb94664432fadddf1a1dadc20f6, user.id=f4c305238f3a4e6eabfcf2068197c2dd) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:19.461753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d7afe-7b38-4607-8fb4-a825341accd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:19.464158 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d7afe-7b38-4607-8fb4-a825341accd5 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:19.466026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155adef2-f040-4d4e-b6f9-a0a66870c3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:19.466763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155adef2-f040-4d4e-b6f9-a0a66870c3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:19.467198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155adef2-f040-4d4e-b6f9-a0a66870c3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:19.467553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155adef2-f040-4d4e-b6f9-a0a66870c3d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:19.468490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155adef2-f040-4d4e-b6f9-a0a66870c3d7 None admin] RBAC: Adding query filter params (role.id=d98e80f5e9c34378bf50e810e4b8a210, scope.project.id=18750bb94664432fadddf1a1dadc20f6, user.id=f4c305238f3a4e6eabfcf2068197c2dd) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:19.468882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155adef2-f040-4d4e-b6f9-a0a66870c3d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:19.469985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 45/90] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:19 2022] GET /identity/v3/role_assignments?user.id=f4c305238f3a4e6eabfcf2068197c2dd&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:19.470768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155adef2-f040-4d4e-b6f9-a0a66870c3d7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:19.470868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d7afe-7b38-4607-8fb4-a825341accd5 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:19.480677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 46/91] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:19 2022] GET /identity/v3/role_assignments?user.id=f4c305238f3a4e6eabfcf2068197c2dd&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=d98e80f5e9c34378bf50e810e4b8a210 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:19.481687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155adef2-f040-4d4e-b6f9-a0a66870c3d7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:19.571249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:19.629742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155adef2-f040-4d4e-b6f9-a0a66870c3d7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:19.673009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d7afe-7b38-4607-8fb4-a825341accd5 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:19.679214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aec04-6b69-4bdf-a191-c7d2e722ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:19.681980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aec04-6b69-4bdf-a191-c7d2e722ad7c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:19.682281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aec04-6b69-4bdf-a191-c7d2e722ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:19.687158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aec04-6b69-4bdf-a191-c7d2e722ad7c None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:19.689733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aec04-6b69-4bdf-a191-c7d2e722ad7c None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:19.691242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aec04-6b69-4bdf-a191-c7d2e722ad7c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:19.701097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 47/92] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:19 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:19.702546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aec04-6b69-4bdf-a191-c7d2e722ad7c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:19.752417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39703e3-055c-4c16-b91e-0f832cb1f951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:19.753399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39703e3-055c-4c16-b91e-0f832cb1f951 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:19.753694 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39703e3-055c-4c16-b91e-0f832cb1f951 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:19.753979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39703e3-055c-4c16-b91e-0f832cb1f951 None admin] PATH_INFO: `/v3/users/f4c305238f3a4e6eabfcf2068197c2dd` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:19.755298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39703e3-055c-4c16-b91e-0f832cb1f951 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c305238f3a4e6eabfcf2068197c2dd)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:19.756827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39703e3-055c-4c16-b91e-0f832cb1f951 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:19.758723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 46/93] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:19 2022] GET /identity/v3/users/f4c305238f3a4e6eabfcf2068197c2dd => generated 275 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:19.765367 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39703e3-055c-4c16-b91e-0f832cb1f951 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:19.785636 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:19.884037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aec04-6b69-4bdf-a191-c7d2e722ad7c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:19.940881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:19.956640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f1ed7-f6d6-4926-92b0-7d345816ad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:19.957664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f1ed7-f6d6-4926-92b0-7d345816ad8a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:19.958169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f1ed7-f6d6-4926-92b0-7d345816ad8a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:19.958659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f1ed7-f6d6-4926-92b0-7d345816ad8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:19.959719 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f1ed7-f6d6-4926-92b0-7d345816ad8a None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=18750bb94664432fadddf1a1dadc20f6, user.id=ac2534ecb2984be38b622993992d8d0d) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:19.960238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f1ed7-f6d6-4926-92b0-7d345816ad8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:19.967605 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f1ed7-f6d6-4926-92b0-7d345816ad8a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:19.967740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39703e3-055c-4c16-b91e-0f832cb1f951 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:19.978882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 48/94] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:19 2022] GET /identity/v3/role_assignments?user.id=ac2534ecb2984be38b622993992d8d0d&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=918b179f19b6437493eabe5394fa9af0 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:20.008849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e06761-3d88-444e-a9c1-e8ea398fe0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:20.010263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06761-3d88-444e-a9c1-e8ea398fe0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:20.010589 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06761-3d88-444e-a9c1-e8ea398fe0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:20.010869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06761-3d88-444e-a9c1-e8ea398fe0b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:20.085514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e06761-3d88-444e-a9c1-e8ea398fe0b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:20.086990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e06761-3d88-444e-a9c1-e8ea398fe0b6 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:20.095792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:20.202297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 47/95] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:20.208021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f1ed7-f6d6-4926-92b0-7d345816ad8a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:20.366239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f1ed7-f6d6-4926-92b0-7d345816ad8a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:20.411362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a932030-349c-4d07-9a8b-59a72968ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:20.412275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a932030-349c-4d07-9a8b-59a72968ba6a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:20.412562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a932030-349c-4d07-9a8b-59a72968ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:20.412839 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a932030-349c-4d07-9a8b-59a72968ba6a None admin] PATH_INFO: `/v3/projects/f8a1242cf39d45afb1146e3e0674dc22` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:20.416862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a932030-349c-4d07-9a8b-59a72968ba6a None admin] RBAC: Authorizing `identity:get_project(project_id=f8a1242cf39d45afb1146e3e0674dc22)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:20.418748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a932030-349c-4d07-9a8b-59a72968ba6a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:20.420824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 49/96] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:20 2022] GET /identity/v3/projects/f8a1242cf39d45afb1146e3e0674dc22 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:20.426423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e06761-3d88-444e-a9c1-e8ea398fe0b6 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:20.554407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e06761-3d88-444e-a9c1-e8ea398fe0b6 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:20.562068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:20.595151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1fec6-3a8d-40de-986f-1e8ccf181f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:20.595846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1fec6-3a8d-40de-986f-1e8ccf181f12 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:20.596134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1fec6-3a8d-40de-986f-1e8ccf181f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:20.596412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1fec6-3a8d-40de-986f-1e8ccf181f12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:20.597259 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1fec6-3a8d-40de-986f-1e8ccf181f12 None admin] RBAC: Adding query filter params (role.id=67cb3b4802a642ae98a93929ca7b724c, scope.project.id=f8a1242cf39d45afb1146e3e0674dc22, user.id=f4c305238f3a4e6eabfcf2068197c2dd) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:20.597574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1fec6-3a8d-40de-986f-1e8ccf181f12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:20.599023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1fec6-3a8d-40de-986f-1e8ccf181f12 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:20.606051 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 48/97] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:20 2022] GET /identity/v3/role_assignments?user.id=f4c305238f3a4e6eabfcf2068197c2dd&scope.project.id=f8a1242cf39d45afb1146e3e0674dc22&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:22.020030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000f6d3-ae94-499c-9212-d60c84e392d4 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.020927 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000f6d3-ae94-499c-9212-d60c84e392d4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.021363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000f6d3-ae94-499c-9212-d60c84e392d4 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.022903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 50/98] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:22.029616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd664ca-19d6-45bc-a04b-792d467d15ea None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.030413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd664ca-19d6-45bc-a04b-792d467d15ea None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.030847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd664ca-19d6-45bc-a04b-792d467d15ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.052605 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-bdd664ca-19d6-45bc-a04b-792d467d15ea None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:22.054146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-bdd664ca-19d6-45bc-a04b-792d467d15ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:22.138014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 49/99] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:22.185049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000f6d3-ae94-499c-9212-d60c84e392d4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:22.237404 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a5c97-eeab-4711-9ecb-4f5eaeb32fd2 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.238166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a5c97-eeab-4711-9ecb-4f5eaeb32fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.238774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a5c97-eeab-4711-9ecb-4f5eaeb32fd2 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.240436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 50/100] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:22.249767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d637a7b-8549-4020-b592-91f8dfa5b5d4 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.250313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d637a7b-8549-4020-b592-91f8dfa5b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.250748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d637a7b-8549-4020-b592-91f8dfa5b5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.291972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:22.293351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-0d637a7b-8549-4020-b592-91f8dfa5b5d4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:22.294604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-0d637a7b-8549-4020-b592-91f8dfa5b5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:22.368943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000f6d3-ae94-499c-9212-d60c84e392d4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:22.427931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 51/101] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:22.432345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3531f-6a9b-4952-9cbd-8e1691573036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:22.433159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3531f-6a9b-4952-9cbd-8e1691573036 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.433445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3531f-6a9b-4952-9cbd-8e1691573036 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.433726 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3531f-6a9b-4952-9cbd-8e1691573036 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.434911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3531f-6a9b-4952-9cbd-8e1691573036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:22.436412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3531f-6a9b-4952-9cbd-8e1691573036 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:22.438030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 51/102] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:22.448904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d637a7b-8549-4020-b592-91f8dfa5b5d4 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:22.460583 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3531f-6a9b-4952-9cbd-8e1691573036 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:22.517131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:22.668192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d637a7b-8549-4020-b592-91f8dfa5b5d4 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:22.674583 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3531f-6a9b-4952-9cbd-8e1691573036 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:22.704020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:22.713222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ef8c9-979f-4053-8364-1c2a38a39e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:22.714397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef8c9-979f-4053-8364-1c2a38a39e89 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.717106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef8c9-979f-4053-8364-1c2a38a39e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.717106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef8c9-979f-4053-8364-1c2a38a39e89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.717284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466ab5d-d59f-40d9-af38-e97578c44b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:22.717284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466ab5d-d59f-40d9-af38-e97578c44b29 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.717284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466ab5d-d59f-40d9-af38-e97578c44b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.717284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466ab5d-d59f-40d9-af38-e97578c44b29 None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.717532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466ab5d-d59f-40d9-af38-e97578c44b29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:22.719221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466ab5d-d59f-40d9-af38-e97578c44b29 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:22.728369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ef8c9-979f-4053-8364-1c2a38a39e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-9e7ef8c9-979f-4053-8364-1c2a38a39e89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:22.736534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:22.737589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:22.738407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:22.740812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 52/103] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:22.742411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0eb0-4a5b-49f1-98ee-d4c44077a0b4 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.743000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0eb0-4a5b-49f1-98ee-d4c44077a0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.744015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb0eb0-4a5b-49f1-98ee-d4c44077a0b4 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.745634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 53/104] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:22.748669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0eb0-4a5b-49f1-98ee-d4c44077a0b4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:22.852697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 52/105] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:53:22 2022] POST /identity/v3/projects => generated 302 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:22.861641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2e2b-41ff-4d9d-bb2f-9295d0726a74 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.861641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2e2b-41ff-4d9d-bb2f-9295d0726a74 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.861641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2e2b-41ff-4d9d-bb2f-9295d0726a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.886250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb0eb0-4a5b-49f1-98ee-d4c44077a0b4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:22.899334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-d2ac2e2b-41ff-4d9d-bb2f-9295d0726a74 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:22.901226 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d2ac2e2b-41ff-4d9d-bb2f-9295d0726a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:22.943308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ff637-59d6-4221-a7c3-d6232e3eea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:22.944465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff637-59d6-4221-a7c3-d6232e3eea42 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.944978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff637-59d6-4221-a7c3-d6232e3eea42 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.945474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ff637-59d6-4221-a7c3-d6232e3eea42 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.947057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ff637-59d6-4221-a7c3-d6232e3eea42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:22.947733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ff637-59d6-4221-a7c3-d6232e3eea42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:22.949524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ff637-59d6-4221-a7c3-d6232e3eea42 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:22.961150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 54/106] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:22.964038 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b0e27-f8d2-44fd-90f2-052602b0d78c None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:22.964579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b0e27-f8d2-44fd-90f2-052602b0d78c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:22.965063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b0e27-f8d2-44fd-90f2-052602b0d78c None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:22.966934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 55/107] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:22.968206 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b0e27-f8d2-44fd-90f2-052602b0d78c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:23.066978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 53/108] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:23.072503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1a38-d5cc-423d-bef5-0ae125607f0a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:23.074116 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1a38-d5cc-423d-bef5-0ae125607f0a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:23.074376 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:23.075112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b1a38-d5cc-423d-bef5-0ae125607f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:23.202332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-767b1a38-d5cc-423d-bef5-0ae125607f0a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:23.203929 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-767b1a38-d5cc-423d-bef5-0ae125607f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:23.215106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:23.259629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b0e27-f8d2-44fd-90f2-052602b0d78c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:23.307334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf537e6a-b1e6-4ab2-b4dd-8e47ce39d500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:23.308708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf537e6a-b1e6-4ab2-b4dd-8e47ce39d500 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:23.309135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 54/109] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:23.309666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf537e6a-b1e6-4ab2-b4dd-8e47ce39d500 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:23.309777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b1a38-d5cc-423d-bef5-0ae125607f0a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:23.310345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf537e6a-b1e6-4ab2-b4dd-8e47ce39d500 None admin] PATH_INFO: `/v3/users/0e7d05a9d1cb42c3891bb27f99e20244` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:23.331477 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf537e6a-b1e6-4ab2-b4dd-8e47ce39d500 None admin] RBAC: Authorizing `identity:get_user(user_id=0e7d05a9d1cb42c3891bb27f99e20244)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:23.333866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf537e6a-b1e6-4ab2-b4dd-8e47ce39d500 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:23.336395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 56/110] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:22 2022] GET /identity/v3/users/0e7d05a9d1cb42c3891bb27f99e20244 => generated 289 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:23.338079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21b08f-eee7-493d-a2d0-5765ebb74ba2 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:23.338701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21b08f-eee7-493d-a2d0-5765ebb74ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:23.339208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21b08f-eee7-493d-a2d0-5765ebb74ba2 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:23.341942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 57/111] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:23.343325 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21b08f-eee7-493d-a2d0-5765ebb74ba2 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:23.432428 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b1a38-d5cc-423d-bef5-0ae125607f0a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:23.476458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52684e-afc9-489a-8c29-19411b5f7102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:23.478101 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52684e-afc9-489a-8c29-19411b5f7102 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:23.478855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52684e-afc9-489a-8c29-19411b5f7102 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:23.479336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52684e-afc9-489a-8c29-19411b5f7102 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:23.481497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21b08f-eee7-493d-a2d0-5765ebb74ba2 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:23.495112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52684e-afc9-489a-8c29-19411b5f7102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:23.504132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-2b52684e-afc9-489a-8c29-19411b5f7102 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:23.506487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:23.507374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:23.508194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:23.510985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 55/112] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:23.514474 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52684e-afc9-489a-8c29-19411b5f7102 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:23.517777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:23.524813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cecb2-f645-4afd-8c16-8bda7a0a1fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:23.525866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cecb2-f645-4afd-8c16-8bda7a0a1fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:23.526144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cecb2-f645-4afd-8c16-8bda7a0a1fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:23.526425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cecb2-f645-4afd-8c16-8bda7a0a1fb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:23.538379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cecb2-f645-4afd-8c16-8bda7a0a1fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-f17cecb2-f645-4afd-8c16-8bda7a0a1fb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:23.547762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:23.548693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:23.549545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:23.554155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 58/113] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:23.557011 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf35a-c3e1-4575-a0ab-d64b5e8b35cd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:23.557301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf35a-c3e1-4575-a0ab-d64b5e8b35cd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:23.557732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf35a-c3e1-4575-a0ab-d64b5e8b35cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:23.582193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-76bdf35a-c3e1-4575-a0ab-d64b5e8b35cd None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:23.583469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-76bdf35a-c3e1-4575-a0ab-d64b5e8b35cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:23.630868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52684e-afc9-489a-8c29-19411b5f7102 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:23.663289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 59/114] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:23.664359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdf35a-c3e1-4575-a0ab-d64b5e8b35cd None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:23.673530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c148-63ca-4141-a366-f073f7e68d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:23.674412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c148-63ca-4141-a366-f073f7e68d24 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:23.674906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c148-63ca-4141-a366-f073f7e68d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:23.675351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c148-63ca-4141-a366-f073f7e68d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:23.754591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c148-63ca-4141-a366-f073f7e68d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:23.756364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c148-63ca-4141-a366-f073f7e68d24 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:23.758590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:23.796137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:23.801308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdf35a-c3e1-4575-a0ab-d64b5e8b35cd None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:23.841818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741c775-9afe-468b-a759-c981842400ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:23.842737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741c775-9afe-468b-a759-c981842400ba None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:23.843167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741c775-9afe-468b-a759-c981842400ba None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:23.843637 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741c775-9afe-468b-a759-c981842400ba None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:23.844541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741c775-9afe-468b-a759-c981842400ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:23.845116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741c775-9afe-468b-a759-c981842400ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:23.846876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741c775-9afe-468b-a759-c981842400ba None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:23.857481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 60/115] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:23.864312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741c775-9afe-468b-a759-c981842400ba None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:23.904615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 56/116] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:23.905547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c148-63ca-4141-a366-f073f7e68d24 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:24.011019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741c775-9afe-468b-a759-c981842400ba None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:24.058806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fa055-7142-443c-b231-9aabf46ae507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:24.059688 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fa055-7142-443c-b231-9aabf46ae507 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.060069 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fa055-7142-443c-b231-9aabf46ae507 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.060354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fa055-7142-443c-b231-9aabf46ae507 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.061124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fa055-7142-443c-b231-9aabf46ae507 None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:24.061442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fa055-7142-443c-b231-9aabf46ae507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:24.062838 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fa055-7142-443c-b231-9aabf46ae507 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:24.070084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c148-63ca-4141-a366-f073f7e68d24 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:24.073527 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 61/117] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:24.074364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fa055-7142-443c-b231-9aabf46ae507 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:24.079836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:24.116721 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7684247-2718-4877-9f7c-84d4cde7fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:24.117528 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684247-2718-4877-9f7c-84d4cde7fea5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.117880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684247-2718-4877-9f7c-84d4cde7fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.118160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7684247-2718-4877-9f7c-84d4cde7fea5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.118983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:24.136398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7684247-2718-4877-9f7c-84d4cde7fea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-e7684247-2718-4877-9f7c-84d4cde7fea5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:24.143099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:24.144948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:24.146625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:24.147907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 57/118] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:24.148623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7684247-2718-4877-9f7c-84d4cde7fea5 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:24.253551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fa055-7142-443c-b231-9aabf46ae507 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:24.289887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b534d9-e2c9-4b36-b844-d29ccc7d0d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:24.291568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b534d9-e2c9-4b36-b844-d29ccc7d0d4c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.292007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b534d9-e2c9-4b36-b844-d29ccc7d0d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.292391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b534d9-e2c9-4b36-b844-d29ccc7d0d4c None admin] PATH_INFO: `/v3/users/f4c305238f3a4e6eabfcf2068197c2dd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.293735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b534d9-e2c9-4b36-b844-d29ccc7d0d4c None admin] RBAC: Authorizing `identity:get_user(user_id=f4c305238f3a4e6eabfcf2068197c2dd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:24.294452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7684247-2718-4877-9f7c-84d4cde7fea5 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:24.295410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b534d9-e2c9-4b36-b844-d29ccc7d0d4c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:24.298263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 62/119] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:24 2022] GET /identity/v3/users/f4c305238f3a4e6eabfcf2068197c2dd => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:24.298657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b534d9-e2c9-4b36-b844-d29ccc7d0d4c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:24.336015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16486b4-abab-4905-b2cc-79b2396db49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:24.337255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16486b4-abab-4905-b2cc-79b2396db49c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.337719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16486b4-abab-4905-b2cc-79b2396db49c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.338185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16486b4-abab-4905-b2cc-79b2396db49c None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.339446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16486b4-abab-4905-b2cc-79b2396db49c None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:24.341088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16486b4-abab-4905-b2cc-79b2396db49c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:24.343064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 58/120] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:24 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:24.343716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16486b4-abab-4905-b2cc-79b2396db49c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:24.381572 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:24.403688 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:24.413227 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b534d9-e2c9-4b36-b844-d29ccc7d0d4c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:24.448738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f7941-2d22-4830-999e-47703380da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:24.449888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f7941-2d22-4830-999e-47703380da12 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.450315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f7941-2d22-4830-999e-47703380da12 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.450851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f7941-2d22-4830-999e-47703380da12 None admin] PATH_INFO: `/v3/users/f4c305238f3a4e6eabfcf2068197c2dd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.452333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f7941-2d22-4830-999e-47703380da12 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c305238f3a4e6eabfcf2068197c2dd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:24.453884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f7941-2d22-4830-999e-47703380da12 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:24.455842 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 63/121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:24 2022] GET /identity/v3/users/f4c305238f3a4e6eabfcf2068197c2dd => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:24.456410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f7941-2d22-4830-999e-47703380da12 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:24.465191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16486b4-abab-4905-b2cc-79b2396db49c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:24.500545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2098b74-7d8e-4148-9b20-344f6ce1a8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:24.501264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098b74-7d8e-4148-9b20-344f6ce1a8bb None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.501563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098b74-7d8e-4148-9b20-344f6ce1a8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.501847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2098b74-7d8e-4148-9b20-344f6ce1a8bb None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.502612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2098b74-7d8e-4148-9b20-344f6ce1a8bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:24.502932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2098b74-7d8e-4148-9b20-344f6ce1a8bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:24.504369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2098b74-7d8e-4148-9b20-344f6ce1a8bb None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:24.517705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 59/122] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:24.517705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38135926-5eed-480a-b885-373269453fad None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.517705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38135926-5eed-480a-b885-373269453fad None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.517705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38135926-5eed-480a-b885-373269453fad None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.517705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 60/123] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:24.517705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38135926-5eed-480a-b885-373269453fad None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:24.570065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f7941-2d22-4830-999e-47703380da12 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:24.609417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaab60-aa24-443a-b40a-0b0df8206bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:24.610385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaab60-aa24-443a-b40a-0b0df8206bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.610908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaab60-aa24-443a-b40a-0b0df8206bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.611046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adaab60-aa24-443a-b40a-0b0df8206bf5 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.612232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adaab60-aa24-443a-b40a-0b0df8206bf5 None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:24.613695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adaab60-aa24-443a-b40a-0b0df8206bf5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:24.615453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 64/124] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:24 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:24.620877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaab60-aa24-443a-b40a-0b0df8206bf5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:24.622610 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:24.632281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38135926-5eed-480a-b885-373269453fad None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:24.651842 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:24.671531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaa83a-bd13-4478-9a0f-865ec6ee85f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:24.672326 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaa83a-bd13-4478-9a0f-865ec6ee85f1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.672646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaa83a-bd13-4478-9a0f-865ec6ee85f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.673112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaa83a-bd13-4478-9a0f-865ec6ee85f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.673753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaa83a-bd13-4478-9a0f-865ec6ee85f1 None admin] RBAC: Adding query filter params (role.id=df5600f31e7047b992c20706ac525a2e, scope.project.id=18750bb94664432fadddf1a1dadc20f6, user.id=0e7d05a9d1cb42c3891bb27f99e20244) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:24.674075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaa83a-bd13-4478-9a0f-865ec6ee85f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:24.675711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaa83a-bd13-4478-9a0f-865ec6ee85f1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:24.691949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 61/125] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:24 2022] GET /identity/v3/role_assignments?user.id=0e7d05a9d1cb42c3891bb27f99e20244&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=df5600f31e7047b992c20706ac525a2e => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:24.691949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaa83a-bd13-4478-9a0f-865ec6ee85f1 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:24.756865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adaab60-aa24-443a-b40a-0b0df8206bf5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:24.796785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fea958-9d04-4eda-8607-9b0eff20d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:24.797837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fea958-9d04-4eda-8607-9b0eff20d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.798130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fea958-9d04-4eda-8607-9b0eff20d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.798412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fea958-9d04-4eda-8607-9b0eff20d4b8 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.799756 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fea958-9d04-4eda-8607-9b0eff20d4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:24.801273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fea958-9d04-4eda-8607-9b0eff20d4b8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:24.803320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 65/126] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:24 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:24.809072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59868-bd09-4aa1-b890-ed4e138431bf None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.809365 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59868-bd09-4aa1-b890-ed4e138431bf None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.809650 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59868-bd09-4aa1-b890-ed4e138431bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.827522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaa83a-bd13-4478-9a0f-865ec6ee85f1 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:24.833507 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6ce59868-bd09-4aa1-b890-ed4e138431bf None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:24.834732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6ce59868-bd09-4aa1-b890-ed4e138431bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:24.883940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5e9b0-92bb-41f9-acd8-ee602a4cddce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:24.885604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5e9b0-92bb-41f9-acd8-ee602a4cddce None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:24.885996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5e9b0-92bb-41f9-acd8-ee602a4cddce None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:24.886619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5e9b0-92bb-41f9-acd8-ee602a4cddce None admin] PATH_INFO: `/v3/users/ac2534ecb2984be38b622993992d8d0d` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:24.888309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5e9b0-92bb-41f9-acd8-ee602a4cddce None admin] RBAC: Authorizing `identity:get_user(user_id=ac2534ecb2984be38b622993992d8d0d)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:24.891150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5e9b0-92bb-41f9-acd8-ee602a4cddce None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:24.892984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 62/127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:24 2022] GET /identity/v3/users/ac2534ecb2984be38b622993992d8d0d => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:24.896497 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5e9b0-92bb-41f9-acd8-ee602a4cddce None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:24.924389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:24.949278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 66/128] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:24.950525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce59868-bd09-4aa1-b890-ed4e138431bf None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:24.992146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:25.024174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5e9b0-92bb-41f9-acd8-ee602a4cddce None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.060168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc9dc4-0fee-46f3-abc4-fe579c267da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.061117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc9dc4-0fee-46f3-abc4-fe579c267da0 None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.061339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc9dc4-0fee-46f3-abc4-fe579c267da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.061628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc9dc4-0fee-46f3-abc4-fe579c267da0 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6/users/f4c305238f3a4e6eabfcf2068197c2dd/roles/d98e80f5e9c34378bf50e810e4b8a210` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.063918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc9dc4-0fee-46f3-abc4-fe579c267da0 None admin] RBAC: Authorizing `identity:create_grant(project_id=18750bb94664432fadddf1a1dadc20f6, user_id=f4c305238f3a4e6eabfcf2068197c2dd, role_id=d98e80f5e9c34378bf50e810e4b8a210)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:25.065417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc9dc4-0fee-46f3-abc4-fe579c267da0 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:25.066311 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce59868-bd09-4aa1-b890-ed4e138431bf None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.104064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae4953-c004-4957-a088-6e1e2b313304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.105252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae4953-c004-4957-a088-6e1e2b313304 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.105719 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae4953-c004-4957-a088-6e1e2b313304 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.106176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae4953-c004-4957-a088-6e1e2b313304 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6/users/f4c305238f3a4e6eabfcf2068197c2dd/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.108344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae4953-c004-4957-a088-6e1e2b313304 None admin] RBAC: Authorizing `identity:create_grant(project_id=18750bb94664432fadddf1a1dadc20f6, user_id=f4c305238f3a4e6eabfcf2068197c2dd, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:25.110111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae4953-c004-4957-a088-6e1e2b313304 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:25.145933 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 63/129] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:24 2022] PUT /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6/users/f4c305238f3a4e6eabfcf2068197c2dd/roles/d98e80f5e9c34378bf50e810e4b8a210 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:25.153108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc9dc4-0fee-46f3-abc4-fe579c267da0 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.248885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 67/130] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:24 2022] PUT /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6/users/f4c305238f3a4e6eabfcf2068197c2dd/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:25.250419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae4953-c004-4957-a088-6e1e2b313304 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.302190 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:25.318168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc9dc4-0fee-46f3-abc4-fe579c267da0 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.378615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cc24c-c6da-4d74-829f-026630deead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.379482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cc24c-c6da-4d74-829f-026630deead8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.379803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cc24c-c6da-4d74-829f-026630deead8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.380089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cc24c-c6da-4d74-829f-026630deead8 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.382536 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cc24c-c6da-4d74-829f-026630deead8 None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:25.387731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cc24c-c6da-4d74-829f-026630deead8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:25.389647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 64/131] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:25 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:25.396565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cc24c-c6da-4d74-829f-026630deead8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.456989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:25.475914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae4953-c004-4957-a088-6e1e2b313304 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.520531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703102f-87db-475d-9529-96d49b569fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.521738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703102f-87db-475d-9529-96d49b569fda None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.526832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703102f-87db-475d-9529-96d49b569fda None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.527754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703102f-87db-475d-9529-96d49b569fda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.545064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703102f-87db-475d-9529-96d49b569fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-5703102f-87db-475d-9529-96d49b569fda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:25.553464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:25.554408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:25.555191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:25.558343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 68/132] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:25.564208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703102f-87db-475d-9529-96d49b569fda None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.591273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cc24c-c6da-4d74-829f-026630deead8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.645840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b95256-8841-4db2-9b89-4796b61db7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.646673 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b95256-8841-4db2-9b89-4796b61db7f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.646966 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b95256-8841-4db2-9b89-4796b61db7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.647252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b95256-8841-4db2-9b89-4796b61db7f0 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6/users/ac2534ecb2984be38b622993992d8d0d/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.653326 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b95256-8841-4db2-9b89-4796b61db7f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=18750bb94664432fadddf1a1dadc20f6, user_id=ac2534ecb2984be38b622993992d8d0d, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:25.654821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b95256-8841-4db2-9b89-4796b61db7f0 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:25.694693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703102f-87db-475d-9529-96d49b569fda None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:25.730751 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 65/133] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:25 2022] PUT /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6/users/ac2534ecb2984be38b622993992d8d0d/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:53:25.736530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f36b7-8de8-4930-8094-3141fb5b29d7 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.737009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f36b7-8de8-4930-8094-3141fb5b29d7 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.737306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f36b7-8de8-4930-8094-3141fb5b29d7 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.738959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 66/134] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:25.745568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ef295-4391-4d73-b1af-da3ce852fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:25.745730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30281fa0-88e0-40a7-b0f0-6dc277e7e8f8 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.745933 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30281fa0-88e0-40a7-b0f0-6dc277e7e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.746196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30281fa0-88e0-40a7-b0f0-6dc277e7e8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.746293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ef295-4391-4d73-b1af-da3ce852fe8e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:25.746527 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ef295-4391-4d73-b1af-da3ce852fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:25.746815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ef295-4391-4d73-b1af-da3ce852fe8e None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:25.747600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ef295-4391-4d73-b1af-da3ce852fe8e None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:25.747925 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ef295-4391-4d73-b1af-da3ce852fe8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:25.749402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ef295-4391-4d73-b1af-da3ce852fe8e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:25.767161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 69/135] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:25.773197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ef295-4391-4d73-b1af-da3ce852fe8e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:25.777441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-30281fa0-88e0-40a7-b0f0-6dc277e7e8f8 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:25.778655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-30281fa0-88e0-40a7-b0f0-6dc277e7e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:25.791993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:25.799743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:25.930408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 67/136] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:25.980144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30281fa0-88e0-40a7-b0f0-6dc277e7e8f8 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:26.016655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ef295-4391-4d73-b1af-da3ce852fe8e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:26.081362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37273f3f-090f-4875-a52a-5e63c82e3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:26.082577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37273f3f-090f-4875-a52a-5e63c82e3888 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:26.082871 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37273f3f-090f-4875-a52a-5e63c82e3888 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:26.083184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37273f3f-090f-4875-a52a-5e63c82e3888 None admin] PATH_INFO: `/v3/users/f4c305238f3a4e6eabfcf2068197c2dd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:26.084845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37273f3f-090f-4875-a52a-5e63c82e3888 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c305238f3a4e6eabfcf2068197c2dd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:26.086651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37273f3f-090f-4875-a52a-5e63c82e3888 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:26.095608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 70/137] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:25 2022] GET /identity/v3/users/f4c305238f3a4e6eabfcf2068197c2dd => generated 275 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:26.111435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37273f3f-090f-4875-a52a-5e63c82e3888 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:26.194502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:26.225153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37273f3f-090f-4875-a52a-5e63c82e3888 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:26.234407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30281fa0-88e0-40a7-b0f0-6dc277e7e8f8 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:26.266041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08ba7-8731-46c5-9bb4-bba6ac84e805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:26.267729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08ba7-8731-46c5-9bb4-bba6ac84e805 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:26.268190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08ba7-8731-46c5-9bb4-bba6ac84e805 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:26.268663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08ba7-8731-46c5-9bb4-bba6ac84e805 None admin] PATH_INFO: `/v3/projects/f8a1242cf39d45afb1146e3e0674dc22` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:26.270388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08ba7-8731-46c5-9bb4-bba6ac84e805 None admin] RBAC: Authorizing `identity:get_project(project_id=f8a1242cf39d45afb1146e3e0674dc22)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:26.272642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08ba7-8731-46c5-9bb4-bba6ac84e805 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:26.275440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 71/138] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:26 2022] GET /identity/v3/projects/f8a1242cf39d45afb1146e3e0674dc22 => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:26.281902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08ba7-8731-46c5-9bb4-bba6ac84e805 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:26.312395 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc5897-40f5-4067-abde-9f4136b2a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:26.313222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc5897-40f5-4067-abde-9f4136b2a722 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:26.313514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc5897-40f5-4067-abde-9f4136b2a722 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:26.313797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc5897-40f5-4067-abde-9f4136b2a722 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:26.315343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc5897-40f5-4067-abde-9f4136b2a722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:26.319750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc5897-40f5-4067-abde-9f4136b2a722 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:26.319750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 68/139] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:26.324585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc5897-40f5-4067-abde-9f4136b2a722 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:26.361393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:26.489959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08ba7-8731-46c5-9bb4-bba6ac84e805 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:26.520821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc5897-40f5-4067-abde-9f4136b2a722 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:26.584303 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2c8f-351e-448e-85e3-a66c97f0f9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:26.585213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2c8f-351e-448e-85e3-a66c97f0f9fe None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:26.585505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2c8f-351e-448e-85e3-a66c97f0f9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:26.585786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2c8f-351e-448e-85e3-a66c97f0f9fe None admin] PATH_INFO: `/v3/projects/f8a1242cf39d45afb1146e3e0674dc22/users/f4c305238f3a4e6eabfcf2068197c2dd/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:26.587956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2c8f-351e-448e-85e3-a66c97f0f9fe None admin] RBAC: Authorizing `identity:create_grant(project_id=f8a1242cf39d45afb1146e3e0674dc22, user_id=f4c305238f3a4e6eabfcf2068197c2dd, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:26.588874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174718c3-2108-4a3f-9837-3be67d4fba46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:26.589493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2c8f-351e-448e-85e3-a66c97f0f9fe None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:26.589598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174718c3-2108-4a3f-9837-3be67d4fba46 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:26.589841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174718c3-2108-4a3f-9837-3be67d4fba46 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:26.590127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174718c3-2108-4a3f-9837-3be67d4fba46 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:26.590969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174718c3-2108-4a3f-9837-3be67d4fba46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:26.592446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174718c3-2108-4a3f-9837-3be67d4fba46 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:26.702178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 72/140] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:26 2022] PUT /identity/v3/projects/f8a1242cf39d45afb1146e3e0674dc22/users/f4c305238f3a4e6eabfcf2068197c2dd/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:26.742593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 69/141] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:26 2022] POST /identity/v3/users => generated 283 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:53:27.377549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0cb3-877d-4185-8ec1-fac8c669d765 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:27.378085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0cb3-877d-4185-8ec1-fac8c669d765 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:27.378161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a0cb3-877d-4185-8ec1-fac8c669d765 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:27.379500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 73/142] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:27.386274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44cd9-eca0-4278-86d4-c075e87715cd None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:27.386711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44cd9-eca0-4278-86d4-c075e87715cd None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:27.386881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44cd9-eca0-4278-86d4-c075e87715cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:27.413324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-11c44cd9-eca0-4278-86d4-c075e87715cd None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:27.414519 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-11c44cd9-eca0-4278-86d4-c075e87715cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:27.489700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:27.497197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 70/143] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:27.545739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a0cb3-877d-4185-8ec1-fac8c669d765 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:27.548926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:27.678408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a0cb3-877d-4185-8ec1-fac8c669d765 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:27.718743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16097-0de6-4f6f-b8f9-7122aa227611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:27.719555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16097-0de6-4f6f-b8f9-7122aa227611 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:27.719862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16097-0de6-4f6f-b8f9-7122aa227611 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:27.720141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd16097-0de6-4f6f-b8f9-7122aa227611 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:27.733717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd16097-0de6-4f6f-b8f9-7122aa227611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-bcd16097-0de6-4f6f-b8f9-7122aa227611 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:27.742109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:27.742971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:27.748291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:27.750468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 74/144] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:27.756691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c44cd9-eca0-4278-86d4-c075e87715cd None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:27.904726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c44cd9-eca0-4278-86d4-c075e87715cd None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:27.953505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef2c5e-86dd-484d-bb51-c995c0a639e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:27.954136 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef2c5e-86dd-484d-bb51-c995c0a639e0 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:27.954433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef2c5e-86dd-484d-bb51-c995c0a639e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:27.954718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef2c5e-86dd-484d-bb51-c995c0a639e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:27.955511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef2c5e-86dd-484d-bb51-c995c0a639e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:27.955855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef2c5e-86dd-484d-bb51-c995c0a639e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:27.957289 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef2c5e-86dd-484d-bb51-c995c0a639e0 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:27.971654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 71/145] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:27.979848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16097-0de6-4f6f-b8f9-7122aa227611 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:28.065256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:28.113447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd16097-0de6-4f6f-b8f9-7122aa227611 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:28.157287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8178f9-8d65-4904-af51-0e3043212279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:28.158528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8178f9-8d65-4904-af51-0e3043212279 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.159064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8178f9-8d65-4904-af51-0e3043212279 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.159540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8178f9-8d65-4904-af51-0e3043212279 None admin] PATH_INFO: `/v3/users/0e7d05a9d1cb42c3891bb27f99e20244` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.161141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8178f9-8d65-4904-af51-0e3043212279 None admin] RBAC: Authorizing `identity:get_user(user_id=0e7d05a9d1cb42c3891bb27f99e20244)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:28.162845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8178f9-8d65-4904-af51-0e3043212279 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:28.165627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 75/146] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:27 2022] GET /identity/v3/users/0e7d05a9d1cb42c3891bb27f99e20244 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:28.171403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef2c5e-86dd-484d-bb51-c995c0a639e0 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:28.265733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:28.315953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef2c5e-86dd-484d-bb51-c995c0a639e0 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:28.367561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14353d6a-2aac-491a-a1c3-548e24d3d28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:28.368512 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353d6a-2aac-491a-a1c3-548e24d3d28e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.368797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353d6a-2aac-491a-a1c3-548e24d3d28e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.369075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14353d6a-2aac-491a-a1c3-548e24d3d28e None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.370453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14353d6a-2aac-491a-a1c3-548e24d3d28e None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:28.371951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14353d6a-2aac-491a-a1c3-548e24d3d28e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:28.373834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 72/147] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:28 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:28.379769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8178f9-8d65-4904-af51-0e3043212279 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:28.507962 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8178f9-8d65-4904-af51-0e3043212279 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:28.540720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:28.547157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f409fc-4916-40ea-af1e-a94656fa6d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:28.548093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f409fc-4916-40ea-af1e-a94656fa6d54 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.548381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f409fc-4916-40ea-af1e-a94656fa6d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.548653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f409fc-4916-40ea-af1e-a94656fa6d54 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6/users/0e7d05a9d1cb42c3891bb27f99e20244/roles/df5600f31e7047b992c20706ac525a2e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.550773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f409fc-4916-40ea-af1e-a94656fa6d54 None admin] RBAC: Authorizing `identity:create_grant(project_id=18750bb94664432fadddf1a1dadc20f6, user_id=0e7d05a9d1cb42c3891bb27f99e20244, role_id=df5600f31e7047b992c20706ac525a2e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:28.552361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f409fc-4916-40ea-af1e-a94656fa6d54 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:28.567197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5854e-6350-4408-973f-d845b9e18c95 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.567703 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5854e-6350-4408-973f-d845b9e18c95 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.567902 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5854e-6350-4408-973f-d845b9e18c95 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.569421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 73/148] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:28.574860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542ac5-2014-4970-b24b-d4d51a191fb6 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.575150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542ac5-2014-4970-b24b-d4d51a191fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.575432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0542ac5-2014-4970-b24b-d4d51a191fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.594009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b0542ac5-2014-4970-b24b-d4d51a191fb6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:28.595200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b0542ac5-2014-4970-b24b-d4d51a191fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:28.639265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 76/149] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:28 2022] PUT /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6/users/0e7d05a9d1cb42c3891bb27f99e20244/roles/df5600f31e7047b992c20706ac525a2e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:28.681877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 74/150] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:28.734561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f409fc-4916-40ea-af1e-a94656fa6d54 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:28.823321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03317dc0-1405-4838-a8fb-76de9938229b None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.823631 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03317dc0-1405-4838-a8fb-76de9938229b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.823826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03317dc0-1405-4838-a8fb-76de9938229b None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.825218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 75/151] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:28.831465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d252f9-b078-44fa-8101-62b0e4e06df5 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.831774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d252f9-b078-44fa-8101-62b0e4e06df5 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.832112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d252f9-b078-44fa-8101-62b0e4e06df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.872839 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-24d252f9-b078-44fa-8101-62b0e4e06df5 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:28.874069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-24d252f9-b078-44fa-8101-62b0e4e06df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:28.897972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f409fc-4916-40ea-af1e-a94656fa6d54 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:28.944623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a28eb-c815-4b3a-971b-68da52ffc4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:28.945525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a28eb-c815-4b3a-971b-68da52ffc4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:28.945808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a28eb-c815-4b3a-971b-68da52ffc4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:28.946638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a28eb-c815-4b3a-971b-68da52ffc4e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:28.956778 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:28.960017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a28eb-c815-4b3a-971b-68da52ffc4e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-400a28eb-c815-4b3a-971b-68da52ffc4e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:28.968882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:28.976674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:28.978054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 77/152] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:28.980009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a28eb-c815-4b3a-971b-68da52ffc4e4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:28.988745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 76/153] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:29.040109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:29.042556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d252f9-b078-44fa-8101-62b0e4e06df5 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:29.090752 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a28eb-c815-4b3a-971b-68da52ffc4e4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:29.128101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e64d9-b9b7-4ca9-9989-598dc796de5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:29.129016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e64d9-b9b7-4ca9-9989-598dc796de5e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:29.129568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e64d9-b9b7-4ca9-9989-598dc796de5e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:29.130295 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e64d9-b9b7-4ca9-9989-598dc796de5e None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:29.132424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e64d9-b9b7-4ca9-9989-598dc796de5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:29.133130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e64d9-b9b7-4ca9-9989-598dc796de5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:29.135809 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e64d9-b9b7-4ca9-9989-598dc796de5e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:29.145385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 78/154] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:29.152389 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e64d9-b9b7-4ca9-9989-598dc796de5e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:29.181385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d252f9-b078-44fa-8101-62b0e4e06df5 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:29.219546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f5827-c184-494d-a7fe-d78241f4be74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:29.220387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f5827-c184-494d-a7fe-d78241f4be74 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:29.220733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f5827-c184-494d-a7fe-d78241f4be74 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:29.220955 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f5827-c184-494d-a7fe-d78241f4be74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:29.233064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f5827-c184-494d-a7fe-d78241f4be74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-471f5827-c184-494d-a7fe-d78241f4be74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:29.241169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:29.242173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:29.243488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 77/155] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:29.249302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f5827-c184-494d-a7fe-d78241f4be74 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:29.266944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e64d9-b9b7-4ca9-9989-598dc796de5e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:29.299744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:29.305347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078e0b1-e6ce-4ec9-836a-244ed14858a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:29.307403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078e0b1-e6ce-4ec9-836a-244ed14858a7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:29.311940 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:29.312672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078e0b1-e6ce-4ec9-836a-244ed14858a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:29.313144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078e0b1-e6ce-4ec9-836a-244ed14858a7 None admin] PATH_INFO: `/v3/users/f4c305238f3a4e6eabfcf2068197c2dd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:29.315185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078e0b1-e6ce-4ec9-836a-244ed14858a7 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c305238f3a4e6eabfcf2068197c2dd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:29.317649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078e0b1-e6ce-4ec9-836a-244ed14858a7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:29.319510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 79/156] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:29 2022] GET /identity/v3/users/f4c305238f3a4e6eabfcf2068197c2dd => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:29.326170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078e0b1-e6ce-4ec9-836a-244ed14858a7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:29.404783 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f5827-c184-494d-a7fe-d78241f4be74 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:29.484096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63738758-a2e3-433f-870d-01d36b059151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:29.484804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63738758-a2e3-433f-870d-01d36b059151 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:29.485143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63738758-a2e3-433f-870d-01d36b059151 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:29.485432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63738758-a2e3-433f-870d-01d36b059151 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:29.486214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63738758-a2e3-433f-870d-01d36b059151 None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:29.486533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63738758-a2e3-433f-870d-01d36b059151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:29.488009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63738758-a2e3-433f-870d-01d36b059151 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:29.505263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 78/157] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:29.511286 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63738758-a2e3-433f-870d-01d36b059151 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:29.626301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078e0b1-e6ce-4ec9-836a-244ed14858a7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:29.716379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdd17c-b3a2-4eea-b12f-c0222e7227f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:29.716971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdd17c-b3a2-4eea-b12f-c0222e7227f2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:29.717261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdd17c-b3a2-4eea-b12f-c0222e7227f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:29.717540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdd17c-b3a2-4eea-b12f-c0222e7227f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:29.751283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63738758-a2e3-433f-870d-01d36b059151 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:29.768704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:29.800051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:29.822279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdd17c-b3a2-4eea-b12f-c0222e7227f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:29.823807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdd17c-b3a2-4eea-b12f-c0222e7227f2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:29.823915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6bb4d-da7f-471c-95cc-5ea39b765ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:29.824765 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6bb4d-da7f-471c-95cc-5ea39b765ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:29.825205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6bb4d-da7f-471c-95cc-5ea39b765ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:29.825538 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6bb4d-da7f-471c-95cc-5ea39b765ba6 None admin] PATH_INFO: `/v3/users/f4c305238f3a4e6eabfcf2068197c2dd` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:29.826775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6bb4d-da7f-471c-95cc-5ea39b765ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c305238f3a4e6eabfcf2068197c2dd)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:29.828266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6bb4d-da7f-471c-95cc-5ea39b765ba6 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:29.830204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 79/158] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:29 2022] GET /identity/v3/users/f4c305238f3a4e6eabfcf2068197c2dd => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:29.837300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6bb4d-da7f-471c-95cc-5ea39b765ba6 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:29.987869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6bb4d-da7f-471c-95cc-5ea39b765ba6 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:29.991034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 80/159] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:30.004644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdd17c-b3a2-4eea-b12f-c0222e7227f2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:30.046038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca44d8e-f510-42b8-915e-bf9862b474d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:30.046720 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca44d8e-f510-42b8-915e-bf9862b474d9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:30.047007 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca44d8e-f510-42b8-915e-bf9862b474d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:30.047290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca44d8e-f510-42b8-915e-bf9862b474d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:30.126925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:30.143977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:30.173567 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdd17c-b3a2-4eea-b12f-c0222e7227f2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:30.193749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca44d8e-f510-42b8-915e-bf9862b474d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:30.195947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca44d8e-f510-42b8-915e-bf9862b474d9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:30.231356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43642d-53c5-4585-8363-25f1889d33c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:30.232259 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43642d-53c5-4585-8363-25f1889d33c7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:30.232544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43642d-53c5-4585-8363-25f1889d33c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:30.232824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43642d-53c5-4585-8363-25f1889d33c7 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:30.236321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43642d-53c5-4585-8363-25f1889d33c7 None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:30.237799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43642d-53c5-4585-8363-25f1889d33c7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:30.239611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 81/160] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:30 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:30.246714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43642d-53c5-4585-8363-25f1889d33c7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:30.378623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43642d-53c5-4585-8363-25f1889d33c7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:30.409853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 80/161] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:30.415832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca44d8e-f510-42b8-915e-bf9862b474d9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:30.425649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe81aa-622f-4496-b193-953609df0146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:30.426324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe81aa-622f-4496-b193-953609df0146 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:30.426612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe81aa-622f-4496-b193-953609df0146 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:30.426890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe81aa-622f-4496-b193-953609df0146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:30.427773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe81aa-622f-4496-b193-953609df0146 None admin] RBAC: Adding query filter params (role.id=d98e80f5e9c34378bf50e810e4b8a210, scope.project.id=18750bb94664432fadddf1a1dadc20f6, user.id=f4c305238f3a4e6eabfcf2068197c2dd) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:30.428097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe81aa-622f-4496-b193-953609df0146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:30.429558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe81aa-622f-4496-b193-953609df0146 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:30.440876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 82/162] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:30 2022] GET /identity/v3/role_assignments?user.id=f4c305238f3a4e6eabfcf2068197c2dd&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=d98e80f5e9c34378bf50e810e4b8a210 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:30.508080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf218b-8d48-41f8-b2e4-aaa15f072a92 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:30.508403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf218b-8d48-41f8-b2e4-aaa15f072a92 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:30.509113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf218b-8d48-41f8-b2e4-aaa15f072a92 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:30.511230 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 83/163] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:30.529813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1cdba-8728-4bf4-a1fe-75da12a8716e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:30.530118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1cdba-8728-4bf4-a1fe-75da12a8716e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:30.530399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1cdba-8728-4bf4-a1fe-75da12a8716e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:30.557490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:30.562320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ded1cdba-8728-4bf4-a1fe-75da12a8716e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:30.563519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ded1cdba-8728-4bf4-a1fe-75da12a8716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:30.583970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:30.599775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca44d8e-f510-42b8-915e-bf9862b474d9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:30.668627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1110e-0ca0-408e-b5f9-ff2bef6fd96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:30.669607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1110e-0ca0-408e-b5f9-ff2bef6fd96c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:30.669898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1110e-0ca0-408e-b5f9-ff2bef6fd96c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:30.670178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1110e-0ca0-408e-b5f9-ff2bef6fd96c None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:30.676533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1110e-0ca0-408e-b5f9-ff2bef6fd96c None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:30.677451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 84/164] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:30.678105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1110e-0ca0-408e-b5f9-ff2bef6fd96c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:30.679873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a18b3-22c3-4296-95e5-d061476763a6 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:30.680290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 81/165] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:30 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:30.680426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a18b3-22c3-4296-95e5-d061476763a6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:30.681012 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a18b3-22c3-4296-95e5-d061476763a6 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:30.682980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 85/166] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:30.686551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1110e-0ca0-408e-b5f9-ff2bef6fd96c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:30.689981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7098-efef-411c-97ac-ea43c304ff0b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:30.690282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7098-efef-411c-97ac-ea43c304ff0b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:30.690572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7098-efef-411c-97ac-ea43c304ff0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:30.720732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c5ad7098-efef-411c-97ac-ea43c304ff0b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:30.721982 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c5ad7098-efef-411c-97ac-ea43c304ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:30.839259 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 86/167] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:30.840528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad7098-efef-411c-97ac-ea43c304ff0b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:30.895601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1110e-0ca0-408e-b5f9-ff2bef6fd96c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:30.965757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15068e-94b1-4bdf-9493-3f017561122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:30.966439 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15068e-94b1-4bdf-9493-3f017561122d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:30.966728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15068e-94b1-4bdf-9493-3f017561122d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:30.967010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15068e-94b1-4bdf-9493-3f017561122d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:30.967972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15068e-94b1-4bdf-9493-3f017561122d None admin] RBAC: Adding query filter params (role.id=67cb3b4802a642ae98a93929ca7b724c, scope.project.id=18750bb94664432fadddf1a1dadc20f6, user.id=f4c305238f3a4e6eabfcf2068197c2dd) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:30.968290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15068e-94b1-4bdf-9493-3f017561122d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:30.969760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15068e-94b1-4bdf-9493-3f017561122d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:30.986189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 82/168] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:30 2022] GET /identity/v3/role_assignments?user.id=f4c305238f3a4e6eabfcf2068197c2dd&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:30.987103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15068e-94b1-4bdf-9493-3f017561122d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:31.000674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:31.008550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:31.070503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad7098-efef-411c-97ac-ea43c304ff0b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:31.156575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cf872-f667-4901-b671-e16f1c37007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:31.157776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cf872-f667-4901-b671-e16f1c37007c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:31.158354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cf872-f667-4901-b671-e16f1c37007c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:31.158831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cf872-f667-4901-b671-e16f1c37007c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:31.183956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15068e-94b1-4bdf-9493-3f017561122d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:31.185167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cf872-f667-4901-b671-e16f1c37007c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-b25cf872-f667-4901-b671-e16f1c37007c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:31.193520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:31.194603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:31.195419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:31.198739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 87/169] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:31.205505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cf872-f667-4901-b671-e16f1c37007c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:31.265840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a49e-53c4-4c7c-91e4-b5629a12ca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:31.266664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a49e-53c4-4c7c-91e4-b5629a12ca4c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:31.266949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a49e-53c4-4c7c-91e4-b5629a12ca4c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:31.267224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5a49e-53c4-4c7c-91e4-b5629a12ca4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:31.296646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5a49e-53c4-4c7c-91e4-b5629a12ca4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-0de5a49e-53c4-4c7c-91e4-b5629a12ca4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:31.304823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:31.305800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:31.307058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 83/170] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:31.312395 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a49e-53c4-4c7c-91e4-b5629a12ca4c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:31.426258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cf872-f667-4901-b671-e16f1c37007c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:31.466899 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:31.488876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:31.501840 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf01f76-b08a-4eb7-a674-86bdf18c4914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:31.502537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf01f76-b08a-4eb7-a674-86bdf18c4914 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:31.502824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf01f76-b08a-4eb7-a674-86bdf18c4914 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:31.503102 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf01f76-b08a-4eb7-a674-86bdf18c4914 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:31.503901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf01f76-b08a-4eb7-a674-86bdf18c4914 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:31.504218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf01f76-b08a-4eb7-a674-86bdf18c4914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:31.505755 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf01f76-b08a-4eb7-a674-86bdf18c4914 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:31.510822 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5a49e-53c4-4c7c-91e4-b5629a12ca4c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:31.518158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 88/171] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:31.525212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf01f76-b08a-4eb7-a674-86bdf18c4914 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:31.595383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a366eb-6162-4d7c-9b0f-66817c42b144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:31.596101 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a366eb-6162-4d7c-9b0f-66817c42b144 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:31.596390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a366eb-6162-4d7c-9b0f-66817c42b144 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:31.596669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a366eb-6162-4d7c-9b0f-66817c42b144 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:31.597438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a366eb-6162-4d7c-9b0f-66817c42b144 None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:31.597755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a366eb-6162-4d7c-9b0f-66817c42b144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:31.599150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a366eb-6162-4d7c-9b0f-66817c42b144 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:31.617275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 84/172] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:31.624750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a366eb-6162-4d7c-9b0f-66817c42b144 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:31.718143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf01f76-b08a-4eb7-a674-86bdf18c4914 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:31.788727 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550018c-98f4-498c-9044-b8336df73767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:31.789611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550018c-98f4-498c-9044-b8336df73767 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:31.790490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550018c-98f4-498c-9044-b8336df73767 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:31.790703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550018c-98f4-498c-9044-b8336df73767 None admin] PATH_INFO: `/v3/users/ac2534ecb2984be38b622993992d8d0d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:31.791973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550018c-98f4-498c-9044-b8336df73767 None admin] RBAC: Authorizing `identity:get_user(user_id=ac2534ecb2984be38b622993992d8d0d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:31.793484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550018c-98f4-498c-9044-b8336df73767 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:31.795545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 89/173] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:31 2022] GET /identity/v3/users/ac2534ecb2984be38b622993992d8d0d => generated 247 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:31.800796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550018c-98f4-498c-9044-b8336df73767 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:31.835476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a366eb-6162-4d7c-9b0f-66817c42b144 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:31.903780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1bc6e-51aa-4ead-a65a-02801fbf9711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:31.906091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1bc6e-51aa-4ead-a65a-02801fbf9711 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:31.906737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1bc6e-51aa-4ead-a65a-02801fbf9711 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:31.908491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1bc6e-51aa-4ead-a65a-02801fbf9711 None admin] PATH_INFO: `/v3/users/f4c305238f3a4e6eabfcf2068197c2dd` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:31.910723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1bc6e-51aa-4ead-a65a-02801fbf9711 None admin] RBAC: Authorizing `identity:get_user(user_id=f4c305238f3a4e6eabfcf2068197c2dd)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:31.915777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:31.916636 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1bc6e-51aa-4ead-a65a-02801fbf9711 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:31.918526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 85/174] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:31 2022] GET /identity/v3/users/f4c305238f3a4e6eabfcf2068197c2dd => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:31.920249 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d63d4-5c76-461d-b686-d81265cd91c0 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:31.928005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d63d4-5c76-461d-b686-d81265cd91c0 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:31.928513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d63d4-5c76-461d-b686-d81265cd91c0 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:31.931017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 86/175] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:31.933027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d63d4-5c76-461d-b686-d81265cd91c0 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:31.951413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:32.023346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550018c-98f4-498c-9044-b8336df73767 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:32.087164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bd450-da74-46de-932d-6fc2b5c3fa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:32.088228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bd450-da74-46de-932d-6fc2b5c3fa96 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.089721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bd450-da74-46de-932d-6fc2b5c3fa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.090198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bd450-da74-46de-932d-6fc2b5c3fa96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.111692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d63d4-5c76-461d-b686-d81265cd91c0 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:32.175509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5313e0-9e3e-418f-bc82-557910fc02f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:32.176545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5313e0-9e3e-418f-bc82-557910fc02f6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.177204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5313e0-9e3e-418f-bc82-557910fc02f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.178342 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5313e0-9e3e-418f-bc82-557910fc02f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.220397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bd450-da74-46de-932d-6fc2b5c3fa96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:32.222236 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bd450-da74-46de-932d-6fc2b5c3fa96 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:32.299962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:32.302125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5313e0-9e3e-418f-bc82-557910fc02f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:32.305995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5313e0-9e3e-418f-bc82-557910fc02f6 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:32.341257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:32.428346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 90/176] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:53:32.435638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebb0c3-615d-46cd-84f0-7fa6b254e7bb None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.436988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebb0c3-615d-46cd-84f0-7fa6b254e7bb None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.437628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebb0c3-615d-46cd-84f0-7fa6b254e7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.472589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a9ebb0c3-615d-46cd-84f0-7fa6b254e7bb None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:32.473787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a9ebb0c3-615d-46cd-84f0-7fa6b254e7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:32.492014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 87/177] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:32.498171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5313e0-9e3e-418f-bc82-557910fc02f6 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:32.633323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:32.639450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5313e0-9e3e-418f-bc82-557910fc02f6 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:32.662889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 91/178] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:32.663831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebb0c3-615d-46cd-84f0-7fa6b254e7bb None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:32.709863 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ee2c8-4980-4954-a3c4-71fe65c41165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:32.710942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ee2c8-4980-4954-a3c4-71fe65c41165 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.711234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ee2c8-4980-4954-a3c4-71fe65c41165 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.711541 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ee2c8-4980-4954-a3c4-71fe65c41165 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.713685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ee2c8-4980-4954-a3c4-71fe65c41165 None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:32.715152 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ee2c8-4980-4954-a3c4-71fe65c41165 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:32.716967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 88/179] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:32.717801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ee2c8-4980-4954-a3c4-71fe65c41165 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:32.802112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:32.813191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebb0c3-615d-46cd-84f0-7fa6b254e7bb None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:32.844235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ee2c8-4980-4954-a3c4-71fe65c41165 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:32.854570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0389f1-f695-4836-9075-61e0bc5e568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:32.855447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0389f1-f695-4836-9075-61e0bc5e568d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.855762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0389f1-f695-4836-9075-61e0bc5e568d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.856162 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0389f1-f695-4836-9075-61e0bc5e568d None admin] PATH_INFO: `/v3/projects/f8a1242cf39d45afb1146e3e0674dc22` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.857347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0389f1-f695-4836-9075-61e0bc5e568d None admin] RBAC: Authorizing `identity:get_project(project_id=f8a1242cf39d45afb1146e3e0674dc22)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:32.858924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0389f1-f695-4836-9075-61e0bc5e568d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:32.865458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 92/180] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/projects/f8a1242cf39d45afb1146e3e0674dc22 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:32.865458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0389f1-f695-4836-9075-61e0bc5e568d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:32.893943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85f459-bfd4-4262-a072-eb4b470fd913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:32.894675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85f459-bfd4-4262-a072-eb4b470fd913 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.894964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85f459-bfd4-4262-a072-eb4b470fd913 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.895250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85f459-bfd4-4262-a072-eb4b470fd913 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.912653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85f459-bfd4-4262-a072-eb4b470fd913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-0e85f459-bfd4-4262-a072-eb4b470fd913 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:32.921363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:32.922356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:32.923206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 89/181] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:32.923888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256828-6886-4575-8a24-94d2e6de8845 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.924433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256828-6886-4575-8a24-94d2e6de8845 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.924433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4256828-6886-4575-8a24-94d2e6de8845 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.925916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 90/182] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:32.926841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b426e10-a51f-4620-9a24-5f777ee8ba2a None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:32.927130 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b426e10-a51f-4620-9a24-5f777ee8ba2a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:32.927616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b426e10-a51f-4620-9a24-5f777ee8ba2a None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:32.928935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 91/183] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:32.929645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b426e10-a51f-4620-9a24-5f777ee8ba2a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:32.957999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:32.973956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0389f1-f695-4836-9075-61e0bc5e568d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.007877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cce29f-86cb-4860-ab46-d038629c56d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.008618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cce29f-86cb-4860-ab46-d038629c56d3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.009109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cce29f-86cb-4860-ab46-d038629c56d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.009398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cce29f-86cb-4860-ab46-d038629c56d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.010235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cce29f-86cb-4860-ab46-d038629c56d3 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=18750bb94664432fadddf1a1dadc20f6, user.id=ac2534ecb2984be38b622993992d8d0d) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:33.010553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cce29f-86cb-4860-ab46-d038629c56d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.012024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cce29f-86cb-4860-ab46-d038629c56d3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.017691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 93/184] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/role_assignments?user.id=ac2534ecb2984be38b622993992d8d0d&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=918b179f19b6437493eabe5394fa9af0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.018889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daec11-3ad4-4438-b400-d25028eb76ff None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.019181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daec11-3ad4-4438-b400-d25028eb76ff None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.019461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17daec11-3ad4-4438-b400-d25028eb76ff None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.020731 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 94/185] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:33.021437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daec11-3ad4-4438-b400-d25028eb76ff None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.042954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b426e10-a51f-4620-9a24-5f777ee8ba2a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.056414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.082731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71854cd-5095-47c6-acb8-242133854590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.083775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71854cd-5095-47c6-acb8-242133854590 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.084213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71854cd-5095-47c6-acb8-242133854590 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.084652 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71854cd-5095-47c6-acb8-242133854590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.085671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71854cd-5095-47c6-acb8-242133854590 None admin] RBAC: Adding query filter params (role.id=67cb3b4802a642ae98a93929ca7b724c, scope.project.id=f8a1242cf39d45afb1146e3e0674dc22, user.id=f4c305238f3a4e6eabfcf2068197c2dd) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:33.086167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71854cd-5095-47c6-acb8-242133854590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.088446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71854cd-5095-47c6-acb8-242133854590 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.095768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 92/186] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:32 2022] GET /identity/v3/role_assignments?user.id=f4c305238f3a4e6eabfcf2068197c2dd&scope.project.id=f8a1242cf39d45afb1146e3e0674dc22&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.097352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf55ef-fc03-4cfb-b15f-95f11ca73f9c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.097648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf55ef-fc03-4cfb-b15f-95f11ca73f9c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.097932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf55ef-fc03-4cfb-b15f-95f11ca73f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.125615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5ccf55ef-fc03-4cfb-b15f-95f11ca73f9c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:33.126888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5ccf55ef-fc03-4cfb-b15f-95f11ca73f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:33.176106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17daec11-3ad4-4438-b400-d25028eb76ff None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.205216 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 93/187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:33.206599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab050ab-a248-4cce-a7cc-6f21d0446d5b None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.206893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab050ab-a248-4cce-a7cc-6f21d0446d5b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.207177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab050ab-a248-4cce-a7cc-6f21d0446d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.235470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-cab050ab-a248-4cce-a7cc-6f21d0446d5b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:33.237862 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-cab050ab-a248-4cce-a7cc-6f21d0446d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:33.242547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dc003-1d0b-4be1-a1a5-c430d90e321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.243447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dc003-1d0b-4be1-a1a5-c430d90e321f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.243750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dc003-1d0b-4be1-a1a5-c430d90e321f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.244027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dc003-1d0b-4be1-a1a5-c430d90e321f None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.244799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dc003-1d0b-4be1-a1a5-c430d90e321f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:33.245107 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dc003-1d0b-4be1-a1a5-c430d90e321f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.246533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dc003-1d0b-4be1-a1a5-c430d90e321f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.254991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.256911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 95/188] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.258256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8e05-db6d-4def-8a90-4d888511aff9 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.258575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8e05-db6d-4def-8a90-4d888511aff9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.258855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab8e05-db6d-4def-8a90-4d888511aff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.278566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-96ab8e05-db6d-4def-8a90-4d888511aff9 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:33.279819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-96ab8e05-db6d-4def-8a90-4d888511aff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:33.338755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 94/189] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:33.339757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab050ab-a248-4cce-a7cc-6f21d0446d5b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.377455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 96/190] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:33.378325 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab8e05-db6d-4def-8a90-4d888511aff9 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.398692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.463373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab050ab-a248-4cce-a7cc-6f21d0446d5b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.486108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab8e05-db6d-4def-8a90-4d888511aff9 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.495603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471510ef-59ef-468b-861c-a4f3e3857624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.496406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471510ef-59ef-468b-861c-a4f3e3857624 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.496684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471510ef-59ef-468b-861c-a4f3e3857624 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.496953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471510ef-59ef-468b-861c-a4f3e3857624 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.498105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471510ef-59ef-468b-861c-a4f3e3857624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.499549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471510ef-59ef-468b-861c-a4f3e3857624 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.501173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 95/191] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.501918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471510ef-59ef-468b-861c-a4f3e3857624 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.520774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.524138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820b42e-7ae3-4d20-ad26-187c5007ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.525010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820b42e-7ae3-4d20-ad26-187c5007ad12 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.525293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820b42e-7ae3-4d20-ad26-187c5007ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.525564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820b42e-7ae3-4d20-ad26-187c5007ad12 None admin] PATH_INFO: `/v3/users/c149b203a84a420f9da97e19c4b8472f` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.538459 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820b42e-7ae3-4d20-ad26-187c5007ad12 None admin] RBAC: Authorizing `identity:get_user(user_id=c149b203a84a420f9da97e19c4b8472f)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.541083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820b42e-7ae3-4d20-ad26-187c5007ad12 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.542240 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 97/192] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/users/c149b203a84a420f9da97e19c4b8472f => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:33.542996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820b42e-7ae3-4d20-ad26-187c5007ad12 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.602639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471510ef-59ef-468b-861c-a4f3e3857624 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.622078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.635885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d5a6-f253-47db-97cf-cf27d29891fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.636680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d5a6-f253-47db-97cf-cf27d29891fe None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.637242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d5a6-f253-47db-97cf-cf27d29891fe None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.637348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2d5a6-f253-47db-97cf-cf27d29891fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.645577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820b42e-7ae3-4d20-ad26-187c5007ad12 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.647302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2d5a6-f253-47db-97cf-cf27d29891fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-d4e2d5a6-f253-47db-97cf-cf27d29891fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:33.656185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:33.657181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:33.657979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 96/193] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:33.659472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d5a6-f253-47db-97cf-cf27d29891fe None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.681337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f91e-73f9-407c-9398-4af039ad517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.682143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f91e-73f9-407c-9398-4af039ad517f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.682423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f91e-73f9-407c-9398-4af039ad517f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.682694 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520f91e-73f9-407c-9398-4af039ad517f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.692543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520f91e-73f9-407c-9398-4af039ad517f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-8520f91e-73f9-407c-9398-4af039ad517f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:33.700642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:33.701538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:33.702327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 98/194] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:33.702992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f91e-73f9-407c-9398-4af039ad517f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.744976 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.765806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2d5a6-f253-47db-97cf-cf27d29891fe None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.799105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fc28f-e255-4c8f-adad-2f5b92d78044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.799802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fc28f-e255-4c8f-adad-2f5b92d78044 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.800098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fc28f-e255-4c8f-adad-2f5b92d78044 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.800375 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fc28f-e255-4c8f-adad-2f5b92d78044 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.801085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fc28f-e255-4c8f-adad-2f5b92d78044 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.802524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fc28f-e255-4c8f-adad-2f5b92d78044 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:33.803682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520f91e-73f9-407c-9398-4af039ad517f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:33.835542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315d5d-63f2-4bef-842e-40fdf18ccd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:33.836225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315d5d-63f2-4bef-842e-40fdf18ccd6b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:33.837108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315d5d-63f2-4bef-842e-40fdf18ccd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:33.837523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6315d5d-63f2-4bef-842e-40fdf18ccd6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:33.840250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:33.895333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 97/195] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:33 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:33.896200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fc28f-e255-4c8f-adad-2f5b92d78044 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:33.907424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6315d5d-63f2-4bef-842e-40fdf18ccd6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:33.909108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6315d5d-63f2-4bef-842e-40fdf18ccd6b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.015465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fc28f-e255-4c8f-adad-2f5b92d78044 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.022490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 99/196] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:34.023677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315d5d-63f2-4bef-842e-40fdf18ccd6b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.058349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4eb98-3123-49b1-8555-5ee200066a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.059040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4eb98-3123-49b1-8555-5ee200066a66 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.059322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4eb98-3123-49b1-8555-5ee200066a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.059619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4eb98-3123-49b1-8555-5ee200066a66 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.060401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4eb98-3123-49b1-8555-5ee200066a66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:34.060707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4eb98-3123-49b1-8555-5ee200066a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.062129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4eb98-3123-49b1-8555-5ee200066a66 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.063773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.064866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.074061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 98/197] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:34.075007 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4eb98-3123-49b1-8555-5ee200066a66 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.145010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6315d5d-63f2-4bef-842e-40fdf18ccd6b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.191310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4eb98-3123-49b1-8555-5ee200066a66 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.193161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eed8f3-d7aa-4d3f-ace6-cfcecda831e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.193843 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eed8f3-d7aa-4d3f-ace6-cfcecda831e9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.194133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eed8f3-d7aa-4d3f-ace6-cfcecda831e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.194412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eed8f3-d7aa-4d3f-ace6-cfcecda831e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.195174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eed8f3-d7aa-4d3f-ace6-cfcecda831e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:34.195636 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eed8f3-d7aa-4d3f-ace6-cfcecda831e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.197552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eed8f3-d7aa-4d3f-ace6-cfcecda831e9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.207963 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 100/198] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:34.208659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eed8f3-d7aa-4d3f-ace6-cfcecda831e9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.238727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf5172-3be0-4f71-b1eb-4cce5ff3bbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.239676 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf5172-3be0-4f71-b1eb-4cce5ff3bbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.239970 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf5172-3be0-4f71-b1eb-4cce5ff3bbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.240254 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf5172-3be0-4f71-b1eb-4cce5ff3bbc8 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.241482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf5172-3be0-4f71-b1eb-4cce5ff3bbc8 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.243151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf5172-3be0-4f71-b1eb-4cce5ff3bbc8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.245154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 99/199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:34.245944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf5172-3be0-4f71-b1eb-4cce5ff3bbc8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.317056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.332409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.340421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eed8f3-d7aa-4d3f-ace6-cfcecda831e9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.362322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf5172-3be0-4f71-b1eb-4cce5ff3bbc8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.378206 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee27af5-3b58-48d8-8698-7006f181be1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.379084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27af5-3b58-48d8-8698-7006f181be1e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.379365 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27af5-3b58-48d8-8698-7006f181be1e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.379706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27af5-3b58-48d8-8698-7006f181be1e None admin] PATH_INFO: `/v3/users/0e7d05a9d1cb42c3891bb27f99e20244` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.381328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee27af5-3b58-48d8-8698-7006f181be1e None admin] RBAC: Authorizing `identity:get_user(user_id=0e7d05a9d1cb42c3891bb27f99e20244)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.382848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee27af5-3b58-48d8-8698-7006f181be1e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.385797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 101/200] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/users/0e7d05a9d1cb42c3891bb27f99e20244 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:34.386757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee27af5-3b58-48d8-8698-7006f181be1e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.412782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fffe9-32aa-40d5-b8b8-53dcb98abbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.413701 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fffe9-32aa-40d5-b8b8-53dcb98abbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.414565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fffe9-32aa-40d5-b8b8-53dcb98abbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.414861 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fffe9-32aa-40d5-b8b8-53dcb98abbc8 None admin] PATH_INFO: `/v3/users/c149b203a84a420f9da97e19c4b8472f` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.416448 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fffe9-32aa-40d5-b8b8-53dcb98abbc8 None admin] RBAC: Authorizing `identity:get_user(user_id=c149b203a84a420f9da97e19c4b8472f)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.418865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fffe9-32aa-40d5-b8b8-53dcb98abbc8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.421766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 100/201] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/users/c149b203a84a420f9da97e19c4b8472f => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:34.422552 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fffe9-32aa-40d5-b8b8-53dcb98abbc8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.501998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee27af5-3b58-48d8-8698-7006f181be1e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.543622 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffc96e-74aa-455c-8160-a39376e50b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.545168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffc96e-74aa-455c-8160-a39376e50b07 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.545662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffc96e-74aa-455c-8160-a39376e50b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.546270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffc96e-74aa-455c-8160-a39376e50b07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.547782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffc96e-74aa-455c-8160-a39376e50b07 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c, user.id=c149b203a84a420f9da97e19c4b8472f) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:34.548389 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffc96e-74aa-455c-8160-a39376e50b07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.549757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fffe9-32aa-40d5-b8b8-53dcb98abbc8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.550243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffc96e-74aa-455c-8160-a39376e50b07 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.558195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 102/202] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/role_assignments?user.id=c149b203a84a420f9da97e19c4b8472f&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=918b179f19b6437493eabe5394fa9af0 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:34.559857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffc96e-74aa-455c-8160-a39376e50b07 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.593428 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55c19e-3b6c-4dc1-a2cb-7f5feb7c3420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.594108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55c19e-3b6c-4dc1-a2cb-7f5feb7c3420 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.594909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55c19e-3b6c-4dc1-a2cb-7f5feb7c3420 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.595195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55c19e-3b6c-4dc1-a2cb-7f5feb7c3420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.598810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.600270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.725122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55c19e-3b6c-4dc1-a2cb-7f5feb7c3420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.726617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55c19e-3b6c-4dc1-a2cb-7f5feb7c3420 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.745620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffc96e-74aa-455c-8160-a39376e50b07 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:34.806229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925d334-61bb-4d0b-b9dc-2291da07f092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:34.806972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925d334-61bb-4d0b-b9dc-2291da07f092 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:34.807164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925d334-61bb-4d0b-b9dc-2291da07f092 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:34.807442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925d334-61bb-4d0b-b9dc-2291da07f092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:34.880442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925d334-61bb-4d0b-b9dc-2291da07f092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:34.882113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925d334-61bb-4d0b-b9dc-2291da07f092 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:34.895439 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 101/203] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:34.910958 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55c19e-3b6c-4dc1-a2cb-7f5feb7c3420 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:34.915513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:34.983960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:35.039374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 103/204] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:35.046469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925d334-61bb-4d0b-b9dc-2291da07f092 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:35.155021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55c19e-3b6c-4dc1-a2cb-7f5feb7c3420 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:35.155644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925d334-61bb-4d0b-b9dc-2291da07f092 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:35.192885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:35.199402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7922b-5f1d-48f8-ae84-e8d2b932046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:35.200525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7922b-5f1d-48f8-ae84-e8d2b932046c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:35.200807 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7922b-5f1d-48f8-ae84-e8d2b932046c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:35.201082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7922b-5f1d-48f8-ae84-e8d2b932046c None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:35.203358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96895081-66d8-4e44-b131-88dae5f7c206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:35.203358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96895081-66d8-4e44-b131-88dae5f7c206 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:35.203561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7922b-5f1d-48f8-ae84-e8d2b932046c None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:35.203675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96895081-66d8-4e44-b131-88dae5f7c206 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:35.203675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96895081-66d8-4e44-b131-88dae5f7c206 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:35.203919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7922b-5f1d-48f8-ae84-e8d2b932046c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:35.204659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96895081-66d8-4e44-b131-88dae5f7c206 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:35.205637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 102/205] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:34 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:35.206402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96895081-66d8-4e44-b131-88dae5f7c206 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:35.208319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 104/206] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:35 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:35.213196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7922b-5f1d-48f8-ae84-e8d2b932046c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:35.215151 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96895081-66d8-4e44-b131-88dae5f7c206 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:35.394883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96895081-66d8-4e44-b131-88dae5f7c206 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:35.411853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7922b-5f1d-48f8-ae84-e8d2b932046c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:35.448091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3f0dc-0da0-473c-9fe8-ebae237b4011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:35.449019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f0dc-0da0-473c-9fe8-ebae237b4011 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:35.449516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f0dc-0da0-473c-9fe8-ebae237b4011 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:35.449990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f0dc-0da0-473c-9fe8-ebae237b4011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:35.451119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3f0dc-0da0-473c-9fe8-ebae237b4011 None admin] RBAC: Adding query filter params (role.id=df5600f31e7047b992c20706ac525a2e, scope.project.id=18750bb94664432fadddf1a1dadc20f6, user.id=0e7d05a9d1cb42c3891bb27f99e20244) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:35.451658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3f0dc-0da0-473c-9fe8-ebae237b4011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:35.453328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3f0dc-0da0-473c-9fe8-ebae237b4011 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:35.460174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 103/207] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:35 2022] GET /identity/v3/role_assignments?user.id=0e7d05a9d1cb42c3891bb27f99e20244&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=df5600f31e7047b992c20706ac525a2e => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:35.461139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:35.476497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d0bd0-f276-4cb6-a605-3391caa3445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:35.477784 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0bd0-f276-4cb6-a605-3391caa3445c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:35.483170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0bd0-f276-4cb6-a605-3391caa3445c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:35.483170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d0bd0-f276-4cb6-a605-3391caa3445c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:35.483170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0bd0-f276-4cb6-a605-3391caa3445c None admin] RBAC: Adding query filter params (role.id=d98e80f5e9c34378bf50e810e4b8a210, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c, user.id=c149b203a84a420f9da97e19c4b8472f) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:35.483170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0bd0-f276-4cb6-a605-3391caa3445c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:35.483170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d0bd0-f276-4cb6-a605-3391caa3445c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:35.488217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 105/208] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:35 2022] GET /identity/v3/role_assignments?user.id=c149b203a84a420f9da97e19c4b8472f&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=d98e80f5e9c34378bf50e810e4b8a210 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:36.562892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b78b8-0136-4025-a1d1-a03795c5d6de None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:36.566096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b78b8-0136-4025-a1d1-a03795c5d6de None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:36.566696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b78b8-0136-4025-a1d1-a03795c5d6de None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:36.568704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 104/209] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:36.575184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff38f2-ab81-4a40-b264-b8791c2bea0b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:36.576065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff38f2-ab81-4a40-b264-b8791c2bea0b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:36.576553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff38f2-ab81-4a40-b264-b8791c2bea0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:36.594560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-04ff38f2-ab81-4a40-b264-b8791c2bea0b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:36.596178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-04ff38f2-ab81-4a40-b264-b8791c2bea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:36.599857 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dde138-23c4-4828-8fb1-93a225fb0c21 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:36.600325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dde138-23c4-4828-8fb1-93a225fb0c21 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:36.600704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dde138-23c4-4828-8fb1-93a225fb0c21 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:36.603734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 105/210] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:36.612304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823b6db-1c7f-4049-adfb-75bd95232768 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:36.612860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823b6db-1c7f-4049-adfb-75bd95232768 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:36.613339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823b6db-1c7f-4049-adfb-75bd95232768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:36.631945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-9823b6db-1c7f-4049-adfb-75bd95232768 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:36.633818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9823b6db-1c7f-4049-adfb-75bd95232768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:36.671546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:36.687128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 106/211] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:36.720667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff38f2-ab81-4a40-b264-b8791c2bea0b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:36.724273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 106/212] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:36.755294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823b6db-1c7f-4049-adfb-75bd95232768 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:36.856277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:36.861637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823b6db-1c7f-4049-adfb-75bd95232768 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:36.864217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff38f2-ab81-4a40-b264-b8791c2bea0b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:36.903317 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28992f56-1346-47ef-af4b-e713043f4598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:36.904310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28992f56-1346-47ef-af4b-e713043f4598 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:36.904688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28992f56-1346-47ef-af4b-e713043f4598 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:36.905220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28992f56-1346-47ef-af4b-e713043f4598 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:36.906585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28992f56-1346-47ef-af4b-e713043f4598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:36.908316 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28992f56-1346-47ef-af4b-e713043f4598 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:36.911667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888bfe-5701-4378-960c-94a7212422dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:36.912623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888bfe-5701-4378-960c-94a7212422dd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:36.913057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888bfe-5701-4378-960c-94a7212422dd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:36.913459 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99888bfe-5701-4378-960c-94a7212422dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:36.915840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 107/213] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:36.917132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28992f56-1346-47ef-af4b-e713043f4598 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:36.927332 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99888bfe-5701-4378-960c-94a7212422dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-99888bfe-5701-4378-960c-94a7212422dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:36.937634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:36.938524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:36.939877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:36.943652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 107/214] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:36.945869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888bfe-5701-4378-960c-94a7212422dd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:37.008499 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:37.033086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28992f56-1346-47ef-af4b-e713043f4598 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:37.064713 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99888bfe-5701-4378-960c-94a7212422dd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:37.067886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f294969-35a7-4b25-a6a7-97ff5a25742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:37.068565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f294969-35a7-4b25-a6a7-97ff5a25742a None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.068849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f294969-35a7-4b25-a6a7-97ff5a25742a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.069126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f294969-35a7-4b25-a6a7-97ff5a25742a None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.069849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f294969-35a7-4b25-a6a7-97ff5a25742a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:37.072075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f294969-35a7-4b25-a6a7-97ff5a25742a None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:37.143476 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702950c-a35e-4d63-8878-d61e979d87d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:37.144098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702950c-a35e-4d63-8878-d61e979d87d8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.144382 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702950c-a35e-4d63-8878-d61e979d87d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.144660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702950c-a35e-4d63-8878-d61e979d87d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.145416 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702950c-a35e-4d63-8878-d61e979d87d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:37.145723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702950c-a35e-4d63-8878-d61e979d87d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:37.147117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702950c-a35e-4d63-8878-d61e979d87d8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:37.156113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 108/215] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:37.157431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b644d6-c41a-4922-a134-3065b3f930cc None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.157720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b644d6-c41a-4922-a134-3065b3f930cc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.157999 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b644d6-c41a-4922-a134-3065b3f930cc None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.159391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 109/216] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:37.161717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b644d6-c41a-4922-a134-3065b3f930cc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:37.211910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 108/217] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:36 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:53:37.211910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2fa1-2292-44c1-a94b-d36dd17671fc None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.211910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2fa1-2292-44c1-a94b-d36dd17671fc None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.211910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a2fa1-2292-44c1-a94b-d36dd17671fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.228801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-581a2fa1-2292-44c1-a94b-d36dd17671fc None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:37.230189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-581a2fa1-2292-44c1-a94b-d36dd17671fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:37.245541 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:37.296302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b644d6-c41a-4922-a134-3065b3f930cc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:37.315239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:37.322995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 109/218] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:37.340837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53cd7f-a469-401f-bc6e-68f9eb1196b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:37.341747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53cd7f-a469-401f-bc6e-68f9eb1196b6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.342088 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53cd7f-a469-401f-bc6e-68f9eb1196b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.342375 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53cd7f-a469-401f-bc6e-68f9eb1196b6 None admin] PATH_INFO: `/v3/users/3774d29b8d5a41458ab5e6c825753cc1` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.346104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a2fa1-2292-44c1-a94b-d36dd17671fc None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:37.361466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53cd7f-a469-401f-bc6e-68f9eb1196b6 None admin] RBAC: Authorizing `identity:get_user(user_id=3774d29b8d5a41458ab5e6c825753cc1)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:37.363201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53cd7f-a469-401f-bc6e-68f9eb1196b6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:37.365838 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 110/219] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:37 2022] GET /identity/v3/users/3774d29b8d5a41458ab5e6c825753cc1 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:37.371520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53cd7f-a469-401f-bc6e-68f9eb1196b6 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:37.469583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a2fa1-2292-44c1-a94b-d36dd17671fc None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:37.486780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53cd7f-a469-401f-bc6e-68f9eb1196b6 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:37.510905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aca2ac-efc0-4355-8d07-83331f45b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:37.511764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca2ac-efc0-4355-8d07-83331f45b9cd None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.512056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca2ac-efc0-4355-8d07-83331f45b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.512337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aca2ac-efc0-4355-8d07-83331f45b9cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.527396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aca2ac-efc0-4355-8d07-83331f45b9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:37.529877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a3bc4-b816-46e2-a8a3-9ebc4dd5a810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:37.530547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3bc4-b816-46e2-a8a3-9ebc4dd5a810 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.530841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3bc4-b816-46e2-a8a3-9ebc4dd5a810 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.531130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a3bc4-b816-46e2-a8a3-9ebc4dd5a810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-26aca2ac-efc0-4355-8d07-83331f45b9cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:37.537568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:37.538488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:37.539396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:37.540737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 110/220] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:37.548368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aca2ac-efc0-4355-8d07-83331f45b9cd None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:37.564331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:37.600138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:37.643273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a3bc4-b816-46e2-a8a3-9ebc4dd5a810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:37.646167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a3bc4-b816-46e2-a8a3-9ebc4dd5a810 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:37.698330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aca2ac-efc0-4355-8d07-83331f45b9cd None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:37.740324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e8001-e479-4761-b8f2-9a0984a115c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:37.740984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e8001-e479-4761-b8f2-9a0984a115c7 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.741270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e8001-e479-4761-b8f2-9a0984a115c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.741547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e8001-e479-4761-b8f2-9a0984a115c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.742304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e8001-e479-4761-b8f2-9a0984a115c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:37.743264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e8001-e479-4761-b8f2-9a0984a115c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:37.744887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e8001-e479-4761-b8f2-9a0984a115c7 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:37.758806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 111/221] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:37.760511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e8001-e479-4761-b8f2-9a0984a115c7 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:37.813323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 111/222] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:53:37.815238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a3bc4-b816-46e2-a8a3-9ebc4dd5a810 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:37.906447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:37.946249 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e8001-e479-4761-b8f2-9a0984a115c7 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:37.978252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:37.988864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8db02-6b1e-49e3-9bd6-3ca9915bc7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:37.989758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8db02-6b1e-49e3-9bd6-3ca9915bc7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.990045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8db02-6b1e-49e3-9bd6-3ca9915bc7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.990375 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8db02-6b1e-49e3-9bd6-3ca9915bc7e6 None admin] PATH_INFO: `/v3/users/c149b203a84a420f9da97e19c4b8472f` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.991557 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8db02-6b1e-49e3-9bd6-3ca9915bc7e6 None admin] RBAC: Authorizing `identity:get_user(user_id=c149b203a84a420f9da97e19c4b8472f)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:37.993240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8db02-6b1e-49e3-9bd6-3ca9915bc7e6 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:37.998655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 112/223] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:37 2022] GET /identity/v3/users/c149b203a84a420f9da97e19c4b8472f => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:37.998655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b5288-b444-49f0-8e8c-07ab24913408 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:37.998655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b5288-b444-49f0-8e8c-07ab24913408 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:37.998655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b5288-b444-49f0-8e8c-07ab24913408 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:37.998655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 113/224] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:38.003272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b5288-b444-49f0-8e8c-07ab24913408 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.009423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a3bc4-b816-46e2-a8a3-9ebc4dd5a810 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.056485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d431a9-4ba9-44d0-8124-878bcb576630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.058834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d431a9-4ba9-44d0-8124-878bcb576630 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.059836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d431a9-4ba9-44d0-8124-878bcb576630 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.060828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d431a9-4ba9-44d0-8124-878bcb576630 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.062580 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d431a9-4ba9-44d0-8124-878bcb576630 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.064992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d431a9-4ba9-44d0-8124-878bcb576630 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.066928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 112/225] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:37 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:38.068568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6a9e-4a17-4125-a997-0f725c5ca2f4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.069068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6a9e-4a17-4125-a997-0f725c5ca2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.069548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e6a9e-4a17-4125-a997-0f725c5ca2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.114375 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c49e6a9e-4a17-4125-a997-0f725c5ca2f4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:38.116114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c49e6a9e-4a17-4125-a997-0f725c5ca2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:38.135809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b5288-b444-49f0-8e8c-07ab24913408 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.173144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc33117-ca27-4851-8615-fdfca25365b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.174042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc33117-ca27-4851-8615-fdfca25365b8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.174328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc33117-ca27-4851-8615-fdfca25365b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.174605 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc33117-ca27-4851-8615-fdfca25365b8 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.175931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc33117-ca27-4851-8615-fdfca25365b8 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.177493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc33117-ca27-4851-8615-fdfca25365b8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.184644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 114/226] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:38.184644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc33117-ca27-4851-8615-fdfca25365b8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.189842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:38.203024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 113/227] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:38.204194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e6a9e-4a17-4125-a997-0f725c5ca2f4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.298565 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:38.316674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc33117-ca27-4851-8615-fdfca25365b8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.341997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e6a9e-4a17-4125-a997-0f725c5ca2f4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.352403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2a88a-e56d-4c24-9e12-d92b07ce69a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.353076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a88a-e56d-4c24-9e12-d92b07ce69a3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.353355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a88a-e56d-4c24-9e12-d92b07ce69a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.353913 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2a88a-e56d-4c24-9e12-d92b07ce69a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.354477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2a88a-e56d-4c24-9e12-d92b07ce69a3 None admin] RBAC: Adding query filter params (role.id=67cb3b4802a642ae98a93929ca7b724c, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c, user.id=3774d29b8d5a41458ab5e6c825753cc1) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:38.354800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2a88a-e56d-4c24-9e12-d92b07ce69a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.356300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2a88a-e56d-4c24-9e12-d92b07ce69a3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.362102 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 115/228] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/role_assignments?user.id=3774d29b8d5a41458ab5e6c825753cc1&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:38.362889 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2a88a-e56d-4c24-9e12-d92b07ce69a3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.390670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97cdfb-aa5a-4130-bc26-3a4d98a47d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.391971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97cdfb-aa5a-4130-bc26-3a4d98a47d09 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.392565 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97cdfb-aa5a-4130-bc26-3a4d98a47d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.393054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97cdfb-aa5a-4130-bc26-3a4d98a47d09 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/users/c149b203a84a420f9da97e19c4b8472f/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.398247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97cdfb-aa5a-4130-bc26-3a4d98a47d09 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bd52514ff434e4eaa4b9885515ae22c, user_id=c149b203a84a420f9da97e19c4b8472f, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.401098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97cdfb-aa5a-4130-bc26-3a4d98a47d09 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.450219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:38.484312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2a88a-e56d-4c24-9e12-d92b07ce69a3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.513182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 114/229] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:38 2022] PUT /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/users/c149b203a84a420f9da97e19c4b8472f/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:38.522583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16932-208b-4572-80b2-a93ce3bc33b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.523455 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16932-208b-4572-80b2-a93ce3bc33b9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.524311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16932-208b-4572-80b2-a93ce3bc33b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.524596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b16932-208b-4572-80b2-a93ce3bc33b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.537744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b16932-208b-4572-80b2-a93ce3bc33b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-31b16932-208b-4572-80b2-a93ce3bc33b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:38.546656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:38.547683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:38.549030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 116/230] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:38.554288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97cdfb-aa5a-4130-bc26-3a4d98a47d09 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.685249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97cdfb-aa5a-4130-bc26-3a4d98a47d09 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.716239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:38.724892 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63818c-6d60-45d1-ad29-1eb76b4d52f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.725802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63818c-6d60-45d1-ad29-1eb76b4d52f9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.726088 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63818c-6d60-45d1-ad29-1eb76b4d52f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.726368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63818c-6d60-45d1-ad29-1eb76b4d52f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.727904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63818c-6d60-45d1-ad29-1eb76b4d52f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:38.733542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63818c-6d60-45d1-ad29-1eb76b4d52f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.733542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63818c-6d60-45d1-ad29-1eb76b4d52f9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.738848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 115/231] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:38.745090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16932-208b-4572-80b2-a93ce3bc33b9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:38.874623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b16932-208b-4572-80b2-a93ce3bc33b9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:38.910992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:38.917838 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d1f91-56f2-4c09-8efc-b564cad92530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:38.918717 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d1f91-56f2-4c09-8efc-b564cad92530 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:38.918997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d1f91-56f2-4c09-8efc-b564cad92530 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:38.919271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d1f91-56f2-4c09-8efc-b564cad92530 None admin] PATH_INFO: `/v3/users/c149b203a84a420f9da97e19c4b8472f` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:38.924429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d1f91-56f2-4c09-8efc-b564cad92530 None admin] RBAC: Authorizing `identity:get_user(user_id=c149b203a84a420f9da97e19c4b8472f)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:38.924429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d1f91-56f2-4c09-8efc-b564cad92530 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:38.924810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 117/232] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/users/c149b203a84a420f9da97e19c4b8472f => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:38.931879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63818c-6d60-45d1-ad29-1eb76b4d52f9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:39.082341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63818c-6d60-45d1-ad29-1eb76b4d52f9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.126558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f82404-e0d2-454f-ba98-b671dd3983a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:39.127691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f82404-e0d2-454f-ba98-b671dd3983a3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.128129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f82404-e0d2-454f-ba98-b671dd3983a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.128557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f82404-e0d2-454f-ba98-b671dd3983a3 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.129913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f82404-e0d2-454f-ba98-b671dd3983a3 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:39.131543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f82404-e0d2-454f-ba98-b671dd3983a3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:39.133572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 116/233] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:38 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:39.139423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d1f91-56f2-4c09-8efc-b564cad92530 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:39.282277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d1f91-56f2-4c09-8efc-b564cad92530 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:39.329615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32ce31-a55d-4187-b06b-f4cc2d7e6d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:39.330564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32ce31-a55d-4187-b06b-f4cc2d7e6d2b None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.330887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32ce31-a55d-4187-b06b-f4cc2d7e6d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.331168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32ce31-a55d-4187-b06b-f4cc2d7e6d2b None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/users/c149b203a84a420f9da97e19c4b8472f/roles/d98e80f5e9c34378bf50e810e4b8a210` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.333435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32ce31-a55d-4187-b06b-f4cc2d7e6d2b None admin] RBAC: Authorizing `identity:create_grant(project_id=0bd52514ff434e4eaa4b9885515ae22c, user_id=c149b203a84a420f9da97e19c4b8472f, role_id=d98e80f5e9c34378bf50e810e4b8a210)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:39.334873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32ce31-a55d-4187-b06b-f4cc2d7e6d2b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:39.459404 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:39 2022] PUT /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/users/c149b203a84a420f9da97e19c4b8472f/roles/d98e80f5e9c34378bf50e810e4b8a210 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:39.978974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33ff41-f160-4456-943d-821e4a6b1c33 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.979500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33ff41-f160-4456-943d-821e4a6b1c33 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.979701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33ff41-f160-4456-943d-821e4a6b1c33 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:39.981199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 117/235] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:39.986644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8e504-7a1a-4a7e-b1ce-f48042a58fed None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:39.987036 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8e504-7a1a-4a7e-b1ce-f48042a58fed None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:39.987204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8e504-7a1a-4a7e-b1ce-f48042a58fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.012585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-35e8e504-7a1a-4a7e-b1ce-f48042a58fed None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:40.013794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-35e8e504-7a1a-4a7e-b1ce-f48042a58fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:40.062192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49db4fa-1d44-4f62-90af-24514ce86c8f None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.062498 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49db4fa-1d44-4f62-90af-24514ce86c8f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.062760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49db4fa-1d44-4f62-90af-24514ce86c8f None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.064181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 118/236] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:40.069329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28ca4a-9e0a-40df-8eac-71bb10bc7a68 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.069618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28ca4a-9e0a-40df-8eac-71bb10bc7a68 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.069904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28ca4a-9e0a-40df-8eac-71bb10bc7a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.093174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6d28ca4a-9e0a-40df-8eac-71bb10bc7a68 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:40.094367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6d28ca4a-9e0a-40df-8eac-71bb10bc7a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:40.098946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:40.133548 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 119/237] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:40.161806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:40.177849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8e504-7a1a-4a7e-b1ce-f48042a58fed None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.179450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 119/238] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:40.204442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28ca4a-9e0a-40df-8eac-71bb10bc7a68 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.320942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28ca4a-9e0a-40df-8eac-71bb10bc7a68 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.364698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcc5b8-a402-4984-a259-7e9d22c23e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.366086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcc5b8-a402-4984-a259-7e9d22c23e7e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.367943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcc5b8-a402-4984-a259-7e9d22c23e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.368446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcc5b8-a402-4984-a259-7e9d22c23e7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.392670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8e504-7a1a-4a7e-b1ce-f48042a58fed None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.393807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcc5b8-a402-4984-a259-7e9d22c23e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-b1fcc5b8-a402-4984-a259-7e9d22c23e7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:40.404024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:40.404974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:40.405763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:40.413027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 120/239] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:40.419142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcc5b8-a402-4984-a259-7e9d22c23e7e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.461960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b90faf-8878-4f32-a7ab-e80ab1d67961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.468582 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90faf-8878-4f32-a7ab-e80ab1d67961 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.468789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90faf-8878-4f32-a7ab-e80ab1d67961 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.469074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90faf-8878-4f32-a7ab-e80ab1d67961 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.470343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b90faf-8878-4f32-a7ab-e80ab1d67961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.471820 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b90faf-8878-4f32-a7ab-e80ab1d67961 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.473660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 120/240] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:40.491275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b90faf-8878-4f32-a7ab-e80ab1d67961 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.501130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:40.560309 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcc5b8-a402-4984-a259-7e9d22c23e7e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.604264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285964e-258c-4b1f-94df-6aed3a3aacf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.604943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285964e-258c-4b1f-94df-6aed3a3aacf2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.605226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285964e-258c-4b1f-94df-6aed3a3aacf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.605501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285964e-258c-4b1f-94df-6aed3a3aacf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.606258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285964e-258c-4b1f-94df-6aed3a3aacf2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:40.606568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285964e-258c-4b1f-94df-6aed3a3aacf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.607987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285964e-258c-4b1f-94df-6aed3a3aacf2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.619977 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:40.630436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 121/241] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:40.636306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285964e-258c-4b1f-94df-6aed3a3aacf2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:40.687877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b90faf-8878-4f32-a7ab-e80ab1d67961 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.725856 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7082c9-5c6f-4cbd-a1a7-2a478a5cd0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.726535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7082c9-5c6f-4cbd-a1a7-2a478a5cd0fa None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.726921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7082c9-5c6f-4cbd-a1a7-2a478a5cd0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.727195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7082c9-5c6f-4cbd-a1a7-2a478a5cd0fa None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.728001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7082c9-5c6f-4cbd-a1a7-2a478a5cd0fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.729512 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7082c9-5c6f-4cbd-a1a7-2a478a5cd0fa None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.791528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285964e-258c-4b1f-94df-6aed3a3aacf2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:40.803242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:40.826405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 121/242] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:40 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:40.836575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68bd46-60c4-4f08-b7c0-0a2555f16039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:40.837476 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68bd46-60c4-4f08-b7c0-0a2555f16039 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:40.837760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68bd46-60c4-4f08-b7c0-0a2555f16039 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:40.838088 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68bd46-60c4-4f08-b7c0-0a2555f16039 None admin] PATH_INFO: `/v3/users/5f8bee68205c43bfba753bd899b2bc1d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:40.861336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68bd46-60c4-4f08-b7c0-0a2555f16039 None admin] RBAC: Authorizing `identity:get_user(user_id=5f8bee68205c43bfba753bd899b2bc1d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:40.861336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68bd46-60c4-4f08-b7c0-0a2555f16039 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:40.863251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 122/243] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:40 2022] GET /identity/v3/users/5f8bee68205c43bfba753bd899b2bc1d => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:40.872803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7082c9-5c6f-4cbd-a1a7-2a478a5cd0fa None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:41.054167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7082c9-5c6f-4cbd-a1a7-2a478a5cd0fa None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:41.069146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:41.092250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5184a-d1f5-4375-9003-8c837da39e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:41.093253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5184a-d1f5-4375-9003-8c837da39e7b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.093786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5184a-d1f5-4375-9003-8c837da39e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.094258 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5184a-d1f5-4375-9003-8c837da39e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.175379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5184a-d1f5-4375-9003-8c837da39e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:41.177369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5184a-d1f5-4375-9003-8c837da39e7b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:41.298071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 122/244] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:41.303977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68bd46-60c4-4f08-b7c0-0a2555f16039 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:41.304566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9589bba-495c-4383-a9e7-316b58291ab5 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.305407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9589bba-495c-4383-a9e7-316b58291ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.305585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9589bba-495c-4383-a9e7-316b58291ab5 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.306995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 123/245] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:41.312152 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87968fe-123e-4edf-b8ed-c49f6f870015 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.312443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87968fe-123e-4edf-b8ed-c49f6f870015 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.312726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87968fe-123e-4edf-b8ed-c49f6f870015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.331214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e87968fe-123e-4edf-b8ed-c49f6f870015 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:41.332454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e87968fe-123e-4edf-b8ed-c49f6f870015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:41.347940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:41.406179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 124/246] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:41.433629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87968fe-123e-4edf-b8ed-c49f6f870015 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:41.435857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68bd46-60c4-4f08-b7c0-0a2555f16039 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:41.473657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabae75-15e4-46fc-b1e7-964212fc04e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:41.474528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabae75-15e4-46fc-b1e7-964212fc04e8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.474806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabae75-15e4-46fc-b1e7-964212fc04e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.475078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabae75-15e4-46fc-b1e7-964212fc04e8 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.477319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabae75-15e4-46fc-b1e7-964212fc04e8 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:41.478774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabae75-15e4-46fc-b1e7-964212fc04e8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:41.480823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 123/247] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:41 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:41.488898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabae75-15e4-46fc-b1e7-964212fc04e8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:41.533260 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:41.548180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87968fe-123e-4edf-b8ed-c49f6f870015 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:41.590627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a5434a-29f5-43e8-8a9e-9b6338a79332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:41.591361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5434a-29f5-43e8-8a9e-9b6338a79332 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.591702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5434a-29f5-43e8-8a9e-9b6338a79332 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.591986 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a5434a-29f5-43e8-8a9e-9b6338a79332 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.607494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabae75-15e4-46fc-b1e7-964212fc04e8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:41.607844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a5434a-29f5-43e8-8a9e-9b6338a79332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-17a5434a-29f5-43e8-8a9e-9b6338a79332 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:41.616957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:41.618019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:41.618798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 125/248] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:41.621592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c0d9-f5e7-4c6f-8616-ccce4aed0eff None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.621592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c0d9-f5e7-4c6f-8616-ccce4aed0eff None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.621592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26c0d9-f5e7-4c6f-8616-ccce4aed0eff None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.622907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 126/249] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:41.628608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27113f-c46b-4c5d-acb1-cc4eb2314cbc None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.628910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27113f-c46b-4c5d-acb1-cc4eb2314cbc None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.629208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27113f-c46b-4c5d-acb1-cc4eb2314cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.636836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:41.649916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-8d27113f-c46b-4c5d-acb1-cc4eb2314cbc None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:41.651424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8d27113f-c46b-4c5d-acb1-cc4eb2314cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:41.654473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9884b-ee04-4051-bdb4-7f2de23fb09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:41.658561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9884b-ee04-4051-bdb4-7f2de23fb09d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.658561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9884b-ee04-4051-bdb4-7f2de23fb09d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.658561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9884b-ee04-4051-bdb4-7f2de23fb09d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.658561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9884b-ee04-4051-bdb4-7f2de23fb09d None admin] RBAC: Adding query filter params (role.id=df5600f31e7047b992c20706ac525a2e, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c, user.id=5f8bee68205c43bfba753bd899b2bc1d) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:41.658561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9884b-ee04-4051-bdb4-7f2de23fb09d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:41.658561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb9884b-ee04-4051-bdb4-7f2de23fb09d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:41.665532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 124/250] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:41 2022] GET /identity/v3/role_assignments?user.id=5f8bee68205c43bfba753bd899b2bc1d&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=df5600f31e7047b992c20706ac525a2e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:41.666402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9884b-ee04-4051-bdb4-7f2de23fb09d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:41.779737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 127/251] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:41.828611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:41.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9884b-ee04-4051-bdb4-7f2de23fb09d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:41.864151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27113f-c46b-4c5d-acb1-cc4eb2314cbc None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:41.904804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a053ce-854a-47d1-b8c3-ea01eb31db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:41.905507 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a053ce-854a-47d1-b8c3-ea01eb31db48 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:41.905795 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a053ce-854a-47d1-b8c3-ea01eb31db48 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:41.906079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a053ce-854a-47d1-b8c3-ea01eb31db48 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:41.906853 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a053ce-854a-47d1-b8c3-ea01eb31db48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:41.907174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a053ce-854a-47d1-b8c3-ea01eb31db48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:41.908677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a053ce-854a-47d1-b8c3-ea01eb31db48 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:41.934367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 125/252] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:41.940095 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a053ce-854a-47d1-b8c3-ea01eb31db48 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:42.017499 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27113f-c46b-4c5d-acb1-cc4eb2314cbc None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:42.053241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:42.059727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807e185-bbf3-4472-b734-e06a5d41ec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:42.060586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807e185-bbf3-4472-b734-e06a5d41ec56 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.061063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807e185-bbf3-4472-b734-e06a5d41ec56 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.061502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807e185-bbf3-4472-b734-e06a5d41ec56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.073178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9807e185-bbf3-4472-b734-e06a5d41ec56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-9807e185-bbf3-4472-b734-e06a5d41ec56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:42.081805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:42.089429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:42.090239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 128/253] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:42.092864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807e185-bbf3-4472-b734-e06a5d41ec56 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:42.177814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a053ce-854a-47d1-b8c3-ea01eb31db48 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:42.205480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9807e185-bbf3-4472-b734-e06a5d41ec56 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:42.248173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8544dcf-37d1-4ad0-b5d9-1f629ae639ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:42.249181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8544dcf-37d1-4ad0-b5d9-1f629ae639ea None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.249613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8544dcf-37d1-4ad0-b5d9-1f629ae639ea None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.250040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8544dcf-37d1-4ad0-b5d9-1f629ae639ea None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.251051 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8544dcf-37d1-4ad0-b5d9-1f629ae639ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:42.251627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8544dcf-37d1-4ad0-b5d9-1f629ae639ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:42.253204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8544dcf-37d1-4ad0-b5d9-1f629ae639ea None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:42.254000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78594a-c4e6-45a1-ae60-d0b8f716e19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:42.255013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78594a-c4e6-45a1-ae60-d0b8f716e19b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.255385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78594a-c4e6-45a1-ae60-d0b8f716e19b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.255785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78594a-c4e6-45a1-ae60-d0b8f716e19b None admin] PATH_INFO: `/v3/users/3774d29b8d5a41458ab5e6c825753cc1` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.258616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78594a-c4e6-45a1-ae60-d0b8f716e19b None admin] RBAC: Authorizing `identity:get_user(user_id=3774d29b8d5a41458ab5e6c825753cc1)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:42.260316 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78594a-c4e6-45a1-ae60-d0b8f716e19b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:42.262391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 126/254] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:41 2022] GET /identity/v3/users/3774d29b8d5a41458ab5e6c825753cc1 => generated 297 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:42.264670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 129/255] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:42.267617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78594a-c4e6-45a1-ae60-d0b8f716e19b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:42.270608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8544dcf-37d1-4ad0-b5d9-1f629ae639ea None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:42.332000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:42.341264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:42.381788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8544dcf-37d1-4ad0-b5d9-1f629ae639ea None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:42.419393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47e3dd-1781-4d17-9a47-eb6e3457f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:42.420609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47e3dd-1781-4d17-9a47-eb6e3457f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.421208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47e3dd-1781-4d17-9a47-eb6e3457f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.421637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47e3dd-1781-4d17-9a47-eb6e3457f6d5 None admin] PATH_INFO: `/v3/users/c149b203a84a420f9da97e19c4b8472f` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.423131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47e3dd-1781-4d17-9a47-eb6e3457f6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=c149b203a84a420f9da97e19c4b8472f)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:42.424773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c47e3dd-1781-4d17-9a47-eb6e3457f6d5 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:42.427076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 130/256] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:42 2022] GET /identity/v3/users/c149b203a84a420f9da97e19c4b8472f => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:42.433141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47e3dd-1781-4d17-9a47-eb6e3457f6d5 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:42.450875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78594a-c4e6-45a1-ae60-d0b8f716e19b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:42.516733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b0b38-49f7-4bf5-a195-bcc219d5d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:42.517878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b0b38-49f7-4bf5-a195-bcc219d5d077 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.518064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b0b38-49f7-4bf5-a195-bcc219d5d077 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.518288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b0b38-49f7-4bf5-a195-bcc219d5d077 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.520356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b0b38-49f7-4bf5-a195-bcc219d5d077 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:42.521812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b0b38-49f7-4bf5-a195-bcc219d5d077 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:42.524414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 127/257] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:42 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:42.530488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b0b38-49f7-4bf5-a195-bcc219d5d077 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:42.544302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47e3dd-1781-4d17-9a47-eb6e3457f6d5 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:42.569159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:42.582381 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad16630-ff0f-4ac1-9d32-b5ffa4a6a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:42.583431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16630-ff0f-4ac1-9d32-b5ffa4a6a481 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.584043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16630-ff0f-4ac1-9d32-b5ffa4a6a481 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.584543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad16630-ff0f-4ac1-9d32-b5ffa4a6a481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.660694 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad16630-ff0f-4ac1-9d32-b5ffa4a6a481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:42.662648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad16630-ff0f-4ac1-9d32-b5ffa4a6a481 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:42.666889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:42.670400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b0b38-49f7-4bf5-a195-bcc219d5d077 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:42.707101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b65dbf-3587-452c-a308-0bb169383857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:42.707936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b65dbf-3587-452c-a308-0bb169383857 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.708221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b65dbf-3587-452c-a308-0bb169383857 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.708498 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b65dbf-3587-452c-a308-0bb169383857 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/users/3774d29b8d5a41458ab5e6c825753cc1/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.710667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b65dbf-3587-452c-a308-0bb169383857 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bd52514ff434e4eaa4b9885515ae22c, user_id=3774d29b8d5a41458ab5e6c825753cc1, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:42.713719 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b65dbf-3587-452c-a308-0bb169383857 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:42.772216 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 131/258] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:53:42.779506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a916c-7144-4883-8b7e-1b9d90c32bb9 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.780089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a916c-7144-4883-8b7e-1b9d90c32bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.780667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a916c-7144-4883-8b7e-1b9d90c32bb9 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.782456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 132/259] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:42.783364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a916c-7144-4883-8b7e-1b9d90c32bb9 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:42.795971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 128/260] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:42 2022] PUT /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/users/3774d29b8d5a41458ab5e6c825753cc1/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:53:42.797335 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2aa23-6677-4dd2-a099-de8201c3df47 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:42.797630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2aa23-6677-4dd2-a099-de8201c3df47 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:42.803071 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2aa23-6677-4dd2-a099-de8201c3df47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:42.811186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:42.845154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b8a2aa23-6677-4dd2-a099-de8201c3df47 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:42.849121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b8a2aa23-6677-4dd2-a099-de8201c3df47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:42.936527 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 129/261] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:42.973130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2aa23-6677-4dd2-a099-de8201c3df47 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:42.997005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a916c-7144-4883-8b7e-1b9d90c32bb9 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:43.090412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd0296-ac8a-4005-981e-10ebd3d62988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:43.091465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd0296-ac8a-4005-981e-10ebd3d62988 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.091789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd0296-ac8a-4005-981e-10ebd3d62988 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.092069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd0296-ac8a-4005-981e-10ebd3d62988 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.096489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd0296-ac8a-4005-981e-10ebd3d62988 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:43.098241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd0296-ac8a-4005-981e-10ebd3d62988 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:43.100162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 133/262] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:42 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:43.102664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:43.111097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd0296-ac8a-4005-981e-10ebd3d62988 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:43.122119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2aa23-6677-4dd2-a099-de8201c3df47 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:43.166750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6db08-2246-4d93-8387-a588da49946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:43.167959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6db08-2246-4d93-8387-a588da49946f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.168491 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6db08-2246-4d93-8387-a588da49946f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.169147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6db08-2246-4d93-8387-a588da49946f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.188689 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6db08-2246-4d93-8387-a588da49946f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6bc6db08-2246-4d93-8387-a588da49946f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:43.203608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:43.204653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:43.205453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:43.208308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 130/263] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:43.213672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6db08-2246-4d93-8387-a588da49946f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:43.242986 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:43.273849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd0296-ac8a-4005-981e-10ebd3d62988 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:43.336052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6db08-2246-4d93-8387-a588da49946f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:43.371494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcbd88-1a6b-475d-b4c6-b5109348ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:43.372179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcbd88-1a6b-475d-b4c6-b5109348ae64 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.372259 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c2596-dc2e-4fbf-852f-c856b84d0958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:43.372521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcbd88-1a6b-475d-b4c6-b5109348ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.372733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcbd88-1a6b-475d-b4c6-b5109348ae64 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.372930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c2596-dc2e-4fbf-852f-c856b84d0958 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.373220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c2596-dc2e-4fbf-852f-c856b84d0958 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.373480 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcbd88-1a6b-475d-b4c6-b5109348ae64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:43.373582 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c2596-dc2e-4fbf-852f-c856b84d0958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.373845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcbd88-1a6b-475d-b4c6-b5109348ae64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:43.374336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c2596-dc2e-4fbf-852f-c856b84d0958 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c, user.id=c149b203a84a420f9da97e19c4b8472f) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:43.374656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c2596-dc2e-4fbf-852f-c856b84d0958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:43.375166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcbd88-1a6b-475d-b4c6-b5109348ae64 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:43.376122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c2596-dc2e-4fbf-852f-c856b84d0958 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:43.384619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 131/264] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:43.389699 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcbd88-1a6b-475d-b4c6-b5109348ae64 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:43.390112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 134/265] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:43 2022] GET /identity/v3/role_assignments?user.id=c149b203a84a420f9da97e19c4b8472f&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=918b179f19b6437493eabe5394fa9af0 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:43.404443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:43.503369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcbd88-1a6b-475d-b4c6-b5109348ae64 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:43.543397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6c3a0-4de3-42a7-a194-250fbfabdf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:43.544375 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6c3a0-4de3-42a7-a194-250fbfabdf57 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.544659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6c3a0-4de3-42a7-a194-250fbfabdf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.544937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6c3a0-4de3-42a7-a194-250fbfabdf57 None admin] PATH_INFO: `/v3/users/c149b203a84a420f9da97e19c4b8472f` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.546146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6c3a0-4de3-42a7-a194-250fbfabdf57 None admin] RBAC: Authorizing `identity:get_user(user_id=c149b203a84a420f9da97e19c4b8472f)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:43.547608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6c3a0-4de3-42a7-a194-250fbfabdf57 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:43.549274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 132/266] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:43 2022] GET /identity/v3/users/c149b203a84a420f9da97e19c4b8472f => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:43.555485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c2596-dc2e-4fbf-852f-c856b84d0958 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:43.674366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c2596-dc2e-4fbf-852f-c856b84d0958 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:43.710579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3de9-93f7-4467-845e-d2a6234ceee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:43.711787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3de9-93f7-4467-845e-d2a6234ceee8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:43.712067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3de9-93f7-4467-845e-d2a6234ceee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:43.712350 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc3de9-93f7-4467-845e-d2a6234ceee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:43.738198 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:43.797990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc3de9-93f7-4467-845e-d2a6234ceee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:43.799477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc3de9-93f7-4467-845e-d2a6234ceee8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:43.928967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 135/267] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:43.939609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6c3a0-4de3-42a7-a194-250fbfabdf57 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:44.079683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:44.118875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6c3a0-4de3-42a7-a194-250fbfabdf57 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:44.178161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69606-0723-4d40-9561-89a13ad88335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:44.179069 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69606-0723-4d40-9561-89a13ad88335 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.179350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69606-0723-4d40-9561-89a13ad88335 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.180249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69606-0723-4d40-9561-89a13ad88335 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.184619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69606-0723-4d40-9561-89a13ad88335 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:44.186129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69606-0723-4d40-9561-89a13ad88335 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:44.188330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 133/268] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:43 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:44.197178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3de9-93f7-4467-845e-d2a6234ceee8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:44.303012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:44.379370 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc3de9-93f7-4467-845e-d2a6234ceee8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:44.453710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884316a-e8dc-408f-a0c4-ec689061faa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:44.454424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884316a-e8dc-408f-a0c4-ec689061faa3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.454716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884316a-e8dc-408f-a0c4-ec689061faa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.454996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884316a-e8dc-408f-a0c4-ec689061faa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.455863 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884316a-e8dc-408f-a0c4-ec689061faa3 None admin] RBAC: Adding query filter params (role.id=d98e80f5e9c34378bf50e810e4b8a210, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c, user.id=c149b203a84a420f9da97e19c4b8472f) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:44.456182 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884316a-e8dc-408f-a0c4-ec689061faa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:44.457679 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884316a-e8dc-408f-a0c4-ec689061faa3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:44.468453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 136/269] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:44 2022] GET /identity/v3/role_assignments?user.id=c149b203a84a420f9da97e19c4b8472f&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=d98e80f5e9c34378bf50e810e4b8a210 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:44.644197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a1782-4bb5-48c6-95a3-0ab8c12de22a None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.644687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a1782-4bb5-48c6-95a3-0ab8c12de22a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.644687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a1782-4bb5-48c6-95a3-0ab8c12de22a None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.646360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 134/270] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:44.653095 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7f7af-3e21-45be-b38a-b6a43b594588 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.653400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7f7af-3e21-45be-b38a-b6a43b594588 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.653661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7f7af-3e21-45be-b38a-b6a43b594588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.675998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5aa7f7af-3e21-45be-b38a-b6a43b594588 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:44.677216 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5aa7f7af-3e21-45be-b38a-b6a43b594588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:44.771182 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 137/271] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:44.798226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a1782-4bb5-48c6-95a3-0ab8c12de22a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:44.912418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614232e7-9f70-4154-a07a-9a4199ea2feb None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.912693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614232e7-9f70-4154-a07a-9a4199ea2feb None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.912883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614232e7-9f70-4154-a07a-9a4199ea2feb None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.919751 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 138/272] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:44.921551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc75d0a-d6fe-45a2-b028-3b9bbf3b0ebb None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.921925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc75d0a-d6fe-45a2-b028-3b9bbf3b0ebb None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.922275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc75d0a-d6fe-45a2-b028-3b9bbf3b0ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.927826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a1782-4bb5-48c6-95a3-0ab8c12de22a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:44.943590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-dbc75d0a-d6fe-45a2-b028-3b9bbf3b0ebb None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:44.944891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-dbc75d0a-d6fe-45a2-b028-3b9bbf3b0ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:44.970750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf60a4-05a5-4651-8f43-306e6ff0b340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:44.971891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf60a4-05a5-4651-8f43-306e6ff0b340 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:44.972661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf60a4-05a5-4651-8f43-306e6ff0b340 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:44.973114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf60a4-05a5-4651-8f43-306e6ff0b340 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:44.978731 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf60a4-05a5-4651-8f43-306e6ff0b340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:44.980301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf60a4-05a5-4651-8f43-306e6ff0b340 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:44.982313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 135/273] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:44.988098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf60a4-05a5-4651-8f43-306e6ff0b340 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.009788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.010772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.050245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 139/274] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:45.086418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc75d0a-d6fe-45a2-b028-3b9bbf3b0ebb None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.131973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf60a4-05a5-4651-8f43-306e6ff0b340 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.177497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c76eaa-f906-4e13-a149-8ed1b8918b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.178107 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76eaa-f906-4e13-a149-8ed1b8918b4f None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.178394 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76eaa-f906-4e13-a149-8ed1b8918b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.178672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76eaa-f906-4e13-a149-8ed1b8918b4f None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.180631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c76eaa-f906-4e13-a149-8ed1b8918b4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:45.182837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c76eaa-f906-4e13-a149-8ed1b8918b4f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:45.206587 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc75d0a-d6fe-45a2-b028-3b9bbf3b0ebb None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.243819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6313575-e4db-4334-887b-1aa7de6c26df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.244620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313575-e4db-4334-887b-1aa7de6c26df None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.244909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313575-e4db-4334-887b-1aa7de6c26df None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.245191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6313575-e4db-4334-887b-1aa7de6c26df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.255201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6313575-e4db-4334-887b-1aa7de6c26df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-c6313575-e4db-4334-887b-1aa7de6c26df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:45.263991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:45.264867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 140/275] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:45.270382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9144e-bc30-4be5-b056-bb71052e5681 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.271095 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9144e-bc30-4be5-b056-bb71052e5681 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.271095 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9144e-bc30-4be5-b056-bb71052e5681 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.271095 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 141/276] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:45.272503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9144e-bc30-4be5-b056-bb71052e5681 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.285058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 136/277] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:53:44 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:45.286536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23222621-763e-494d-9d84-96cc5b6d59d8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.286979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23222621-763e-494d-9d84-96cc5b6d59d8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.287397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23222621-763e-494d-9d84-96cc5b6d59d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.309068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-23222621-763e-494d-9d84-96cc5b6d59d8 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:45.311314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-23222621-763e-494d-9d84-96cc5b6d59d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:45.337585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.395158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.400951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 137/278] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:45.410135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9144e-bc30-4be5-b056-bb71052e5681 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.426067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23222621-763e-494d-9d84-96cc5b6d59d8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.451365 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdb207-d290-4248-bf40-2e84fb3ac016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.452569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdb207-d290-4248-bf40-2e84fb3ac016 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.453056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdb207-d290-4248-bf40-2e84fb3ac016 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.453531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdb207-d290-4248-bf40-2e84fb3ac016 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.463854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdb207-d290-4248-bf40-2e84fb3ac016 None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:45.463854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdb207-d290-4248-bf40-2e84fb3ac016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:45.463854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdb207-d290-4248-bf40-2e84fb3ac016 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:45.467118 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 142/279] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:45.472897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdb207-d290-4248-bf40-2e84fb3ac016 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.551716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23222621-763e-494d-9d84-96cc5b6d59d8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.594576 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.596522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770b7d0-fe30-4db1-80c6-a9ec23d7154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.597299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdb207-d290-4248-bf40-2e84fb3ac016 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.597411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b7d0-fe30-4db1-80c6-a9ec23d7154a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.597665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b7d0-fe30-4db1-80c6-a9ec23d7154a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.597993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b7d0-fe30-4db1-80c6-a9ec23d7154a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.612359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770b7d0-fe30-4db1-80c6-a9ec23d7154a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-5770b7d0-fe30-4db1-80c6-a9ec23d7154a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:45.622331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:45.623258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:45.624205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 138/280] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:45.629664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770b7d0-fe30-4db1-80c6-a9ec23d7154a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.641716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dac58-5683-4638-ba4c-3b7942de0dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.643403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dac58-5683-4638-ba4c-3b7942de0dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.643895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dac58-5683-4638-ba4c-3b7942de0dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.644355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dac58-5683-4638-ba4c-3b7942de0dc3 None admin] PATH_INFO: `/v3/users/8e8b14271e344d01ae1d325f47c441ff` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.663246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dac58-5683-4638-ba4c-3b7942de0dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=8e8b14271e344d01ae1d325f47c441ff)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:45.666910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dac58-5683-4638-ba4c-3b7942de0dc3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:45.669762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 143/281] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/users/8e8b14271e344d01ae1d325f47c441ff => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:45.676364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dac58-5683-4638-ba4c-3b7942de0dc3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.714861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:45.767436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770b7d0-fe30-4db1-80c6-a9ec23d7154a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.808049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03dd6f-8552-4ea9-9d49-a6cae41fc593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.809617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03dd6f-8552-4ea9-9d49-a6cae41fc593 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.810088 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03dd6f-8552-4ea9-9d49-a6cae41fc593 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.810567 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03dd6f-8552-4ea9-9d49-a6cae41fc593 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.811458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dac58-5683-4638-ba4c-3b7942de0dc3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:45.811735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03dd6f-8552-4ea9-9d49-a6cae41fc593 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:45.812220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03dd6f-8552-4ea9-9d49-a6cae41fc593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:45.814935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03dd6f-8552-4ea9-9d49-a6cae41fc593 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:45.826352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 139/282] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:45.831273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03dd6f-8552-4ea9-9d49-a6cae41fc593 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:45.854738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d35eb6-cd06-4c98-9318-e60078c458bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:45.855405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d35eb6-cd06-4c98-9318-e60078c458bb None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:45.855742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d35eb6-cd06-4c98-9318-e60078c458bb None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:45.856019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d35eb6-cd06-4c98-9318-e60078c458bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:45.856856 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d35eb6-cd06-4c98-9318-e60078c458bb None admin] RBAC: Adding query filter params (role.id=67cb3b4802a642ae98a93929ca7b724c, user.id=8e8b14271e344d01ae1d325f47c441ff, scope.system=all) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:45.857174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d35eb6-cd06-4c98-9318-e60078c458bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:45.861183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d35eb6-cd06-4c98-9318-e60078c458bb None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:45.870459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 144/283] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/role_assignments?user.id=8e8b14271e344d01ae1d325f47c441ff&scope.system=all&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:46.012183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03dd6f-8552-4ea9-9d49-a6cae41fc593 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.051005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:46.070029 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a17de0-491b-4f81-b42c-af473106d241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.071799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a17de0-491b-4f81-b42c-af473106d241 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.072080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a17de0-491b-4f81-b42c-af473106d241 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.072360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a17de0-491b-4f81-b42c-af473106d241 None admin] PATH_INFO: `/v3/users/5f8bee68205c43bfba753bd899b2bc1d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.076539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a17de0-491b-4f81-b42c-af473106d241 None admin] RBAC: Authorizing `identity:get_user(user_id=5f8bee68205c43bfba753bd899b2bc1d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:46.078132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a17de0-491b-4f81-b42c-af473106d241 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:46.080343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 140/284] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:45 2022] GET /identity/v3/users/5f8bee68205c43bfba753bd899b2bc1d => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:46.085919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d35eb6-cd06-4c98-9318-e60078c458bb None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.097056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e218e-0508-4ed2-b43a-9d112cefa7e6 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.097370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e218e-0508-4ed2-b43a-9d112cefa7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.097616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e218e-0508-4ed2-b43a-9d112cefa7e6 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.102062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 141/285] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:46.105229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72be84-7ba6-4cbc-811f-2c4447f21a9f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.105514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72be84-7ba6-4cbc-811f-2c4447f21a9f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.105793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72be84-7ba6-4cbc-811f-2c4447f21a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.131484 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:46.138362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1c72be84-7ba6-4cbc-811f-2c4447f21a9f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:46.139616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1c72be84-7ba6-4cbc-811f-2c4447f21a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:46.266330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 142/286] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:46.275011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d35eb6-cd06-4c98-9318-e60078c458bb None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.323239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c822b-dfee-4b95-8272-353d370dbf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.324157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c822b-dfee-4b95-8272-353d370dbf8e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.324450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c822b-dfee-4b95-8272-353d370dbf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.324734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c822b-dfee-4b95-8272-353d370dbf8e None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.328322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c822b-dfee-4b95-8272-353d370dbf8e None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:46.329794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c822b-dfee-4b95-8272-353d370dbf8e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:46.331608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 145/287] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:46.337437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72be84-7ba6-4cbc-811f-2c4447f21a9f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.340710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c822b-dfee-4b95-8272-353d370dbf8e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.440141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:46.450052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c822b-dfee-4b95-8272-353d370dbf8e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.486071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adac22-783c-44c4-a743-d843997d7c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.486877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adac22-783c-44c4-a743-d843997d7c7d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.487168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adac22-783c-44c4-a743-d843997d7c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.487449 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adac22-783c-44c4-a743-d843997d7c7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.499467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adac22-783c-44c4-a743-d843997d7c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-e6adac22-783c-44c4-a743-d843997d7c7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:46.512616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:46.513566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:46.516749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 146/288] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:46.519855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adac22-783c-44c4-a743-d843997d7c7d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.573731 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72be84-7ba6-4cbc-811f-2c4447f21a9f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.625540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adac22-783c-44c4-a743-d843997d7c7d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.627020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:46.662620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd5685-d83b-424e-ba30-8ca6c9186080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.663473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd5685-d83b-424e-ba30-8ca6c9186080 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.664004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd5685-d83b-424e-ba30-8ca6c9186080 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.664388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd5685-d83b-424e-ba30-8ca6c9186080 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.665254 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd5685-d83b-424e-ba30-8ca6c9186080 None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:46.665689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd5685-d83b-424e-ba30-8ca6c9186080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:46.667181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd5685-d83b-424e-ba30-8ca6c9186080 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:46.668824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977739b-bab9-4382-ab9d-f95837222192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.669910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977739b-bab9-4382-ab9d-f95837222192 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.675600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977739b-bab9-4382-ab9d-f95837222192 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.676257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977739b-bab9-4382-ab9d-f95837222192 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/users/5f8bee68205c43bfba753bd899b2bc1d/roles/df5600f31e7047b992c20706ac525a2e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.677710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 147/289] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:46.682534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977739b-bab9-4382-ab9d-f95837222192 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bd52514ff434e4eaa4b9885515ae22c, user_id=5f8bee68205c43bfba753bd899b2bc1d, role_id=df5600f31e7047b992c20706ac525a2e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:46.683718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd5685-d83b-424e-ba30-8ca6c9186080 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:46.684539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977739b-bab9-4382-ab9d-f95837222192 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:46.700282 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:46.780639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 143/290] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:53:46 2022] PUT /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/users/5f8bee68205c43bfba753bd899b2bc1d/roles/df5600f31e7047b992c20706ac525a2e => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:53:46.791036 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd5685-d83b-424e-ba30-8ca6c9186080 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:46.831891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459dc3d-b0ed-4bfb-9d59-014a7e4ce670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:46.832780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459dc3d-b0ed-4bfb-9d59-014a7e4ce670 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:46.833070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459dc3d-b0ed-4bfb-9d59-014a7e4ce670 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:46.833352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459dc3d-b0ed-4bfb-9d59-014a7e4ce670 None admin] PATH_INFO: `/v3/users/3774d29b8d5a41458ab5e6c825753cc1` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:46.834572 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459dc3d-b0ed-4bfb-9d59-014a7e4ce670 None admin] RBAC: Authorizing `identity:get_user(user_id=3774d29b8d5a41458ab5e6c825753cc1)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:46.836523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459dc3d-b0ed-4bfb-9d59-014a7e4ce670 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:46.838421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 148/291] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/users/3774d29b8d5a41458ab5e6c825753cc1 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:46.844415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977739b-bab9-4382-ab9d-f95837222192 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:47.001601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977739b-bab9-4382-ab9d-f95837222192 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:47.039410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c32b61-0b31-4223-9491-774046b46d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:47.040111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32b61-0b31-4223-9491-774046b46d77 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.040392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32b61-0b31-4223-9491-774046b46d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.040668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32b61-0b31-4223-9491-774046b46d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.090996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:47.111130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c32b61-0b31-4223-9491-774046b46d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:47.112670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c32b61-0b31-4223-9491-774046b46d77 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:47.240255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 144/292] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:47.246264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459dc3d-b0ed-4bfb-9d59-014a7e4ce670 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:47.386343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:47.408231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459dc3d-b0ed-4bfb-9d59-014a7e4ce670 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:47.457545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8749f92-ca46-4cc0-8d39-9713857d20dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:47.458422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8749f92-ca46-4cc0-8d39-9713857d20dc None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.458710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8749f92-ca46-4cc0-8d39-9713857d20dc None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.458992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8749f92-ca46-4cc0-8d39-9713857d20dc None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.460211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8749f92-ca46-4cc0-8d39-9713857d20dc None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:47.462527 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8749f92-ca46-4cc0-8d39-9713857d20dc None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:47.464639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 149/293] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:47 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:47.470413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c32b61-0b31-4223-9491-774046b46d77 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:47.561484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:47.581960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c32b61-0b31-4223-9491-774046b46d77 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:47.626805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd0f19-6ec5-44a0-9da0-d0a60b9c33fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:47.627477 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd0f19-6ec5-44a0-9da0-d0a60b9c33fc None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:47.627796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd0f19-6ec5-44a0-9da0-d0a60b9c33fc None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:47.628078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd0f19-6ec5-44a0-9da0-d0a60b9c33fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:47.628921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd0f19-6ec5-44a0-9da0-d0a60b9c33fc None admin] RBAC: Adding query filter params (role.id=67cb3b4802a642ae98a93929ca7b724c, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c, user.id=3774d29b8d5a41458ab5e6c825753cc1) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:47.629242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd0f19-6ec5-44a0-9da0-d0a60b9c33fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:47.630693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd0f19-6ec5-44a0-9da0-d0a60b9c33fc None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:47.638675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 145/294] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:47 2022] GET /identity/v3/role_assignments?user.id=3774d29b8d5a41458ab5e6c825753cc1&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:48.090328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecce2b-59ec-4aa0-9a49-7fd6ea97c155 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.090732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecce2b-59ec-4aa0-9a49-7fd6ea97c155 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.090909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecce2b-59ec-4aa0-9a49-7fd6ea97c155 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.092591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 150/295] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:48.097869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda1c4a-1a6a-49d3-b312-16f48422625f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.098716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda1c4a-1a6a-49d3-b312-16f48422625f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.099160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda1c4a-1a6a-49d3-b312-16f48422625f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.117397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bcda1c4a-1a6a-49d3-b312-16f48422625f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:48.118837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bcda1c4a-1a6a-49d3-b312-16f48422625f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:48.195484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 146/296] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:48.221442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecce2b-59ec-4aa0-9a49-7fd6ea97c155 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.346869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecce2b-59ec-4aa0-9a49-7fd6ea97c155 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.381360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd2a72-aa89-48a4-8d99-b30d49fe1094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.382156 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd2a72-aa89-48a4-8d99-b30d49fe1094 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.382950 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd2a72-aa89-48a4-8d99-b30d49fe1094 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.383234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd2a72-aa89-48a4-8d99-b30d49fe1094 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.393880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd2a72-aa89-48a4-8d99-b30d49fe1094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-78cd2a72-aa89-48a4-8d99-b30d49fe1094 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:48.402192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:48.403068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:48.403918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 151/297] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:48.410768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda1c4a-1a6a-49d3-b312-16f48422625f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.486557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.514291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda1c4a-1a6a-49d3-b312-16f48422625f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.531733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aff8d-e36e-4058-a2e9-683299bc735b None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.532029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aff8d-e36e-4058-a2e9-683299bc735b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.532313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aff8d-e36e-4058-a2e9-683299bc735b None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.533958 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 152/298] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:53:48.540227 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05436054-3449-43dd-a5f6-c0a39b56386c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.540522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05436054-3449-43dd-a5f6-c0a39b56386c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.540810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05436054-3449-43dd-a5f6-c0a39b56386c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.552158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c116d-84b5-4fa1-b3d5-7dc0ba240f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.552839 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c116d-84b5-4fa1-b3d5-7dc0ba240f4a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.553132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c116d-84b5-4fa1-b3d5-7dc0ba240f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.553414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c116d-84b5-4fa1-b3d5-7dc0ba240f4a None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.554172 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c116d-84b5-4fa1-b3d5-7dc0ba240f4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:48.555294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c116d-84b5-4fa1-b3d5-7dc0ba240f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:48.556966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c116d-84b5-4fa1-b3d5-7dc0ba240f4a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:48.558757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-05436054-3449-43dd-a5f6-c0a39b56386c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:48.560392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-05436054-3449-43dd-a5f6-c0a39b56386c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:48.563871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.566778 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 147/299] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:48.573457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c116d-84b5-4fa1-b3d5-7dc0ba240f4a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.636996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 153/300] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:48.638247 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc6da-7497-4db3-bb33-ebcc0efe4ede None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.638555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc6da-7497-4db3-bb33-ebcc0efe4ede None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.638828 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bc6da-7497-4db3-bb33-ebcc0efe4ede None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.640243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 154/301] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:48.645268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d544-3854-4fcd-acaa-590e29357a7d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.645555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d544-3854-4fcd-acaa-590e29357a7d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.645833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7d544-3854-4fcd-acaa-590e29357a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.662984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f9f7d544-3854-4fcd-acaa-590e29357a7d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:48.664237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f9f7d544-3854-4fcd-acaa-590e29357a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:48.705956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c116d-84b5-4fa1-b3d5-7dc0ba240f4a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.731267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 155/302] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:48.736558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7d544-3854-4fcd-acaa-590e29357a7d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.744502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392ae6a-bc60-47a1-a050-2d939677fd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.745637 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392ae6a-bc60-47a1-a050-2d939677fd33 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.746610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392ae6a-bc60-47a1-a050-2d939677fd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.747120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392ae6a-bc60-47a1-a050-2d939677fd33 None admin] PATH_INFO: `/v3/users/92d3d6cab46043d98e71efb69ea2f98d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.752060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.764308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392ae6a-bc60-47a1-a050-2d939677fd33 None admin] RBAC: Authorizing `identity:get_user(user_id=92d3d6cab46043d98e71efb69ea2f98d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:48.765787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392ae6a-bc60-47a1-a050-2d939677fd33 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:48.771915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 148/303] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/users/92d3d6cab46043d98e71efb69ea2f98d => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:48.771915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392ae6a-bc60-47a1-a050-2d939677fd33 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.813110 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:48.847536 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7d544-3854-4fcd-acaa-590e29357a7d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.884296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392ae6a-bc60-47a1-a050-2d939677fd33 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:48.889352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fcfdb-a112-41de-864b-643f4bd789bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.890092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fcfdb-a112-41de-864b-643f4bd789bc None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.890376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fcfdb-a112-41de-864b-643f4bd789bc None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.890650 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fcfdb-a112-41de-864b-643f4bd789bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.891859 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fcfdb-a112-41de-864b-643f4bd789bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:48.893293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fcfdb-a112-41de-864b-643f4bd789bc None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:48.895128 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 156/304] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:48.900250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fcfdb-a112-41de-864b-643f4bd789bc None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:48.921226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e95ee-2b1c-4432-9758-d8f8821a10fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:48.922032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e95ee-2b1c-4432-9758-d8f8821a10fa None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:48.922314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e95ee-2b1c-4432-9758-d8f8821a10fa None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:48.922980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e95ee-2b1c-4432-9758-d8f8821a10fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:48.934356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e95ee-2b1c-4432-9758-d8f8821a10fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6c3e95ee-2b1c-4432-9758-d8f8821a10fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:48.942114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:48.943051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 149/305] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:48.944647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e95ee-2b1c-4432-9758-d8f8821a10fa None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.002581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.008580 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fcfdb-a112-41de-864b-643f4bd789bc None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.044457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72208e-5378-40e8-9860-ff127bf46cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.045114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72208e-5378-40e8-9860-ff127bf46cfd None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.045395 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72208e-5378-40e8-9860-ff127bf46cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.045906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72208e-5378-40e8-9860-ff127bf46cfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.046493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72208e-5378-40e8-9860-ff127bf46cfd None admin] RBAC: Adding query filter params (role.id=df5600f31e7047b992c20706ac525a2e, user.id=92d3d6cab46043d98e71efb69ea2f98d, scope.system=all) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:49.046815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72208e-5378-40e8-9860-ff127bf46cfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.048304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72208e-5378-40e8-9860-ff127bf46cfd None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.053902 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.054025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e95ee-2b1c-4432-9758-d8f8821a10fa None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.054120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 157/306] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jun 2 09:53:48 2022] GET /identity/v3/role_assignments?user.id=92d3d6cab46043d98e71efb69ea2f98d&scope.system=all&role.id=df5600f31e7047b992c20706ac525a2e => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:49.054846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72208e-5378-40e8-9860-ff127bf46cfd None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.103977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f8904-2e15-4fe5-8478-9ae0588ed473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.104679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f8904-2e15-4fe5-8478-9ae0588ed473 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.104923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f8904-2e15-4fe5-8478-9ae0588ed473 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.105284 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f8904-2e15-4fe5-8478-9ae0588ed473 None admin] PATH_INFO: `/v3/groups` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.106002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f8904-2e15-4fe5-8478-9ae0588ed473 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.107484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f8904-2e15-4fe5-8478-9ae0588ed473 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.182034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72208e-5378-40e8-9860-ff127bf46cfd None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.203621 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 150/307] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Jun 2 09:53:48 2022] POST /identity/v3/groups => generated 229 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:49.232896 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2feded-11e4-4a4f-99d2-390509c6ff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.233649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2feded-11e4-4a4f-99d2-390509c6ff8c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.233935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2feded-11e4-4a4f-99d2-390509c6ff8c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.234210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2feded-11e4-4a4f-99d2-390509c6ff8c None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.235056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2feded-11e4-4a4f-99d2-390509c6ff8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:49.235368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2feded-11e4-4a4f-99d2-390509c6ff8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.236916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2feded-11e4-4a4f-99d2-390509c6ff8c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.248171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 158/308] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:49.254383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f8904-2e15-4fe5-8478-9ae0588ed473 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.370040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f8904-2e15-4fe5-8478-9ae0588ed473 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.393158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.409914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03511982-96f4-42fc-a925-0bef92d92cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.410815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511982-96f4-42fc-a925-0bef92d92cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.411098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511982-96f4-42fc-a925-0bef92d92cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.413746 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511982-96f4-42fc-a925-0bef92d92cb3 None admin] PATH_INFO: `/v3/users/8e8b14271e344d01ae1d325f47c441ff` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.413746 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03511982-96f4-42fc-a925-0bef92d92cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=8e8b14271e344d01ae1d325f47c441ff)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.414189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03511982-96f4-42fc-a925-0bef92d92cb3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.416639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 151/309] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/users/8e8b14271e344d01ae1d325f47c441ff => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:49.422168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2feded-11e4-4a4f-99d2-390509c6ff8c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.490407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.531145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2feded-11e4-4a4f-99d2-390509c6ff8c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.560480 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cdc20-7f8f-4923-bf73-253d5262289b None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.560790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cdc20-7f8f-4923-bf73-253d5262289b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.561047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cdc20-7f8f-4923-bf73-253d5262289b None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.562552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 152/310] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:49.569559 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082151c-0db3-4ec6-b72e-43f0bed52813 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.570064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082151c-0db3-4ec6-b72e-43f0bed52813 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.570223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082151c-0db3-4ec6-b72e-43f0bed52813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.573502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa1551-d593-4be2-acc4-bf5007442aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.574372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa1551-d593-4be2-acc4-bf5007442aba None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.574656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa1551-d593-4be2-acc4-bf5007442aba None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.574935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa1551-d593-4be2-acc4-bf5007442aba None admin] PATH_INFO: `/v3/system/users/8e8b14271e344d01ae1d325f47c441ff/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.576456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa1551-d593-4be2-acc4-bf5007442aba None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8e8b14271e344d01ae1d325f47c441ff, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:49.577846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa1551-d593-4be2-acc4-bf5007442aba None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:49.597678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8082151c-0db3-4ec6-b72e-43f0bed52813 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:49.599158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8082151c-0db3-4ec6-b72e-43f0bed52813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:49.672596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 159/311] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Jun 2 09:53:49 2022] PUT /identity/v3/system/users/8e8b14271e344d01ae1d325f47c441ff/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:49.678291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 153/312] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:49.699557 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa1551-d593-4be2-acc4-bf5007442aba None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:49.828751 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa1551-d593-4be2-acc4-bf5007442aba None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:49.859761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:49.870706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542fb03-e25a-49fa-827d-8d2d5371860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:49.871520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542fb03-e25a-49fa-827d-8d2d5371860d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:49.871930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542fb03-e25a-49fa-827d-8d2d5371860d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:49.872210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542fb03-e25a-49fa-827d-8d2d5371860d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:49.884603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542fb03-e25a-49fa-827d-8d2d5371860d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-0542fb03-e25a-49fa-827d-8d2d5371860d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:49.892516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:49.893585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:49.894377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:49.895356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 160/313] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:49.900738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082151c-0db3-4ec6-b72e-43f0bed52813 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:50.017770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082151c-0db3-4ec6-b72e-43f0bed52813 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:50.032932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:50.058398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbabb4-e8e1-4e89-919d-93912c304e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:50.059079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbabb4-e8e1-4e89-919d-93912c304e86 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:50.059366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbabb4-e8e1-4e89-919d-93912c304e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:50.059761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbabb4-e8e1-4e89-919d-93912c304e86 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:50.060535 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbabb4-e8e1-4e89-919d-93912c304e86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:50.060852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbabb4-e8e1-4e89-919d-93912c304e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:50.062238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbabb4-e8e1-4e89-919d-93912c304e86 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:50.071398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 154/314] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:50.077300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542fb03-e25a-49fa-827d-8d2d5371860d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:50.186895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542fb03-e25a-49fa-827d-8d2d5371860d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:50.225925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541460c-2432-4727-99e0-43db65b001a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:50.226914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541460c-2432-4727-99e0-43db65b001a3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:50.227199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541460c-2432-4727-99e0-43db65b001a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:50.227475 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541460c-2432-4727-99e0-43db65b001a3 None admin] PATH_INFO: `/v3/users/5f8bee68205c43bfba753bd899b2bc1d` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:50.228799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541460c-2432-4727-99e0-43db65b001a3 None admin] RBAC: Authorizing `identity:get_user(user_id=5f8bee68205c43bfba753bd899b2bc1d)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:50.230253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541460c-2432-4727-99e0-43db65b001a3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:50.232253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 161/315] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:50 2022] GET /identity/v3/users/5f8bee68205c43bfba753bd899b2bc1d => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:50.240779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbabb4-e8e1-4e89-919d-93912c304e86 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:50.349593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbabb4-e8e1-4e89-919d-93912c304e86 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:50.385424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9c118-bedd-4ef5-80ac-fc12a6ea2a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:50.386089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9c118-bedd-4ef5-80ac-fc12a6ea2a73 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:50.386414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9c118-bedd-4ef5-80ac-fc12a6ea2a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:50.386700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9c118-bedd-4ef5-80ac-fc12a6ea2a73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:50.433934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:50.460049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9c118-bedd-4ef5-80ac-fc12a6ea2a73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:50.462203 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9c118-bedd-4ef5-80ac-fc12a6ea2a73 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:50.568439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 155/316] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:50.576784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541460c-2432-4727-99e0-43db65b001a3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:50.635615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:50.687188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541460c-2432-4727-99e0-43db65b001a3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:50.723480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5d785-f7dc-440a-9c9f-c92ff22bf143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:50.724308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5d785-f7dc-440a-9c9f-c92ff22bf143 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:50.724595 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5d785-f7dc-440a-9c9f-c92ff22bf143 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:50.724870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5d785-f7dc-440a-9c9f-c92ff22bf143 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:50.726744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5d785-f7dc-440a-9c9f-c92ff22bf143 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:50.728236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5d785-f7dc-440a-9c9f-c92ff22bf143 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:50.729943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 162/317] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:50 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:50.735804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9c118-bedd-4ef5-80ac-fc12a6ea2a73 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:50.820578 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:50.839122 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9c118-bedd-4ef5-80ac-fc12a6ea2a73 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:50.876253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f29c8-4696-4551-9c4d-27ac2c22ce9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:50.876934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f29c8-4696-4551-9c4d-27ac2c22ce9f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:50.877222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f29c8-4696-4551-9c4d-27ac2c22ce9f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:50.877501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f29c8-4696-4551-9c4d-27ac2c22ce9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:50.878358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f29c8-4696-4551-9c4d-27ac2c22ce9f None admin] RBAC: Adding query filter params (role.id=df5600f31e7047b992c20706ac525a2e, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c, user.id=5f8bee68205c43bfba753bd899b2bc1d) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:50.878678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f29c8-4696-4551-9c4d-27ac2c22ce9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:50.883208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f29c8-4696-4551-9c4d-27ac2c22ce9f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:50.887692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 156/318] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:53:50 2022] GET /identity/v3/role_assignments?user.id=5f8bee68205c43bfba753bd899b2bc1d&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=df5600f31e7047b992c20706ac525a2e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:51.425658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9949e3-d673-4228-a803-bf20896de353 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.425947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9949e3-d673-4228-a803-bf20896de353 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.426228 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9949e3-d673-4228-a803-bf20896de353 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.427760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 163/319] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:51.432819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94ab4-2810-4fee-8df8-58fd354ec30a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.433279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94ab4-2810-4fee-8df8-58fd354ec30a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.433379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd94ab4-2810-4fee-8df8-58fd354ec30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.450729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7cd94ab4-2810-4fee-8df8-58fd354ec30a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:51.451949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7cd94ab4-2810-4fee-8df8-58fd354ec30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:51.523629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 157/320] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:51.542682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9949e3-d673-4228-a803-bf20896de353 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:51.644765 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9949e3-d673-4228-a803-bf20896de353 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:51.647010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c416e-317e-4900-97c8-c09e6235917e None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.647304 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c416e-317e-4900-97c8-c09e6235917e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.647618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c416e-317e-4900-97c8-c09e6235917e None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.649716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 158/321] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:51.655349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455c328-fc7f-4b7c-a517-9d578f7e1b59 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.657772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455c328-fc7f-4b7c-a517-9d578f7e1b59 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.657772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455c328-fc7f-4b7c-a517-9d578f7e1b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.676572 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:51.681943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1455c328-fc7f-4b7c-a517-9d578f7e1b59 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:51.695812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1455c328-fc7f-4b7c-a517-9d578f7e1b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:51.695952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d050b-61fc-4a4c-9ff3-5dde6087fda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:51.695952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d050b-61fc-4a4c-9ff3-5dde6087fda8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.695952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d050b-61fc-4a4c-9ff3-5dde6087fda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.695952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d050b-61fc-4a4c-9ff3-5dde6087fda8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.701988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d050b-61fc-4a4c-9ff3-5dde6087fda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-b93d050b-61fc-4a4c-9ff3-5dde6087fda8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:51.709816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:51.710973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:51.711900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 164/322] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:51.717764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d050b-61fc-4a4c-9ff3-5dde6087fda8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:51.762915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:51.771778 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 159/323] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:51.789868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455c328-fc7f-4b7c-a517-9d578f7e1b59 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:51.824506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d050b-61fc-4a4c-9ff3-5dde6087fda8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:51.856402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092fa9-f67f-44b7-a713-3c385cf78e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:51.857076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092fa9-f67f-44b7-a713-3c385cf78e45 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.857359 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092fa9-f67f-44b7-a713-3c385cf78e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.857634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06092fa9-f67f-44b7-a713-3c385cf78e45 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.859646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06092fa9-f67f-44b7-a713-3c385cf78e45 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:51.859646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06092fa9-f67f-44b7-a713-3c385cf78e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:51.860103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06092fa9-f67f-44b7-a713-3c385cf78e45 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:51.872646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 165/324] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:51.878180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092fa9-f67f-44b7-a713-3c385cf78e45 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:51.898910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455c328-fc7f-4b7c-a517-9d578f7e1b59 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:51.937691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ec296-2b6e-42c4-a585-d8653ca1628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:51.938421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ec296-2b6e-42c4-a585-d8653ca1628e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:51.938725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ec296-2b6e-42c4-a585-d8653ca1628e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:51.938992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ec296-2b6e-42c4-a585-d8653ca1628e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:51.940217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ec296-2b6e-42c4-a585-d8653ca1628e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:51.941704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ec296-2b6e-42c4-a585-d8653ca1628e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:51.947826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:51.948799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 160/325] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:53:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:51.949544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ec296-2b6e-42c4-a585-d8653ca1628e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:51.983113 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06092fa9-f67f-44b7-a713-3c385cf78e45 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.018598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16603fd7-f2a2-4d0d-aab4-60921081ccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:52.019471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16603fd7-f2a2-4d0d-aab4-60921081ccfc None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.019793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16603fd7-f2a2-4d0d-aab4-60921081ccfc None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.020070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16603fd7-f2a2-4d0d-aab4-60921081ccfc None admin] PATH_INFO: `/v3/users/92d3d6cab46043d98e71efb69ea2f98d` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.020174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:52.021542 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16603fd7-f2a2-4d0d-aab4-60921081ccfc None admin] RBAC: Authorizing `identity:get_user(user_id=92d3d6cab46043d98e71efb69ea2f98d)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:52.023140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16603fd7-f2a2-4d0d-aab4-60921081ccfc None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:52.024811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 166/326] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:51 2022] GET /identity/v3/users/92d3d6cab46043d98e71efb69ea2f98d => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:52.030487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16603fd7-f2a2-4d0d-aab4-60921081ccfc None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:52.060477 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ec296-2b6e-42c4-a585-d8653ca1628e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.097570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f053f1c-bc1b-4504-a63c-238f5b6b9a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:52.098233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f053f1c-bc1b-4504-a63c-238f5b6b9a00 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.098516 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f053f1c-bc1b-4504-a63c-238f5b6b9a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.098790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f053f1c-bc1b-4504-a63c-238f5b6b9a00 None admin] PATH_INFO: `/v3/groups` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.099505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f053f1c-bc1b-4504-a63c-238f5b6b9a00 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:52.101495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f053f1c-bc1b-4504-a63c-238f5b6b9a00 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:52.136303 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16603fd7-f2a2-4d0d-aab4-60921081ccfc None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.148733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:52.169762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 161/327] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Jun 2 09:53:51 2022] POST /identity/v3/groups => generated 226 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:53:52.171040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cde9e-c4b1-41e9-a0c4-2fbbd3428282 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.171505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cde9e-c4b1-41e9-a0c4-2fbbd3428282 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.171818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cde9e-c4b1-41e9-a0c4-2fbbd3428282 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.173091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 162/328] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:52.178377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa02b1-30b4-4a4d-bb26-a4fa9ffd7f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:52.180031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa02b1-30b4-4a4d-bb26-a4fa9ffd7f85 None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.180284 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580ea60-fd35-4e68-9d74-bb79f640c079 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.180396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa02b1-30b4-4a4d-bb26-a4fa9ffd7f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.180632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580ea60-fd35-4e68-9d74-bb79f640c079 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.180742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa02b1-30b4-4a4d-bb26-a4fa9ffd7f85 None admin] PATH_INFO: `/v3/system/users/92d3d6cab46043d98e71efb69ea2f98d/roles/df5600f31e7047b992c20706ac525a2e` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.180914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580ea60-fd35-4e68-9d74-bb79f640c079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.182268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa02b1-30b4-4a4d-bb26-a4fa9ffd7f85 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=92d3d6cab46043d98e71efb69ea2f98d, role_id=df5600f31e7047b992c20706ac525a2e)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:52.183763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa02b1-30b4-4a4d-bb26-a4fa9ffd7f85 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:52.200291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2580ea60-fd35-4e68-9d74-bb79f640c079 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:52.200291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2580ea60-fd35-4e68-9d74-bb79f640c079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:52.249592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 167/329] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Jun 2 09:53:52 2022] PUT /identity/v3/system/users/92d3d6cab46043d98e71efb69ea2f98d/roles/df5600f31e7047b992c20706ac525a2e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:53:52.281205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 163/330] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:52.306295 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa02b1-30b4-4a4d-bb26-a4fa9ffd7f85 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:52.428355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa02b1-30b4-4a4d-bb26-a4fa9ffd7f85 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.465881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872174e0-73b4-45fd-a7e4-818dd9b56381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:52.466623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872174e0-73b4-45fd-a7e4-818dd9b56381 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.466912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872174e0-73b4-45fd-a7e4-818dd9b56381 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.467189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872174e0-73b4-45fd-a7e4-818dd9b56381 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.478758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872174e0-73b4-45fd-a7e4-818dd9b56381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-872174e0-73b4-45fd-a7e4-818dd9b56381 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:52.486585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:52.487480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:52.488382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 168/331] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:53:52.495048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580ea60-fd35-4e68-9d74-bb79f640c079 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:52.561485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:52.608041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580ea60-fd35-4e68-9d74-bb79f640c079 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.644119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac9d95-1288-493e-a12c-eb9ccbd222a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:52.644806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9d95-1288-493e-a12c-eb9ccbd222a4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.645097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9d95-1288-493e-a12c-eb9ccbd222a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.645464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9d95-1288-493e-a12c-eb9ccbd222a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.646232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac9d95-1288-493e-a12c-eb9ccbd222a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:52.646559 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac9d95-1288-493e-a12c-eb9ccbd222a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:52.648505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac9d95-1288-493e-a12c-eb9ccbd222a4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:52.658452 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 164/332] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:52.664119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872174e0-73b4-45fd-a7e4-818dd9b56381 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:52.712189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:52.788559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872174e0-73b4-45fd-a7e4-818dd9b56381 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.823900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c42f92-707a-47d1-8e8b-021dd33782ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:52.824830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c42f92-707a-47d1-8e8b-021dd33782ee None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:52.825115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c42f92-707a-47d1-8e8b-021dd33782ee None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:52.825390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c42f92-707a-47d1-8e8b-021dd33782ee None admin] PATH_INFO: `/v3/users/8e8b14271e344d01ae1d325f47c441ff` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:52.826598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c42f92-707a-47d1-8e8b-021dd33782ee None admin] RBAC: Authorizing `identity:get_user(user_id=8e8b14271e344d01ae1d325f47c441ff)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:52.828090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c42f92-707a-47d1-8e8b-021dd33782ee None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:52.830030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 169/333] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:52 2022] GET /identity/v3/users/8e8b14271e344d01ae1d325f47c441ff => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:52.835620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac9d95-1288-493e-a12c-eb9ccbd222a4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:52.959716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac9d95-1288-493e-a12c-eb9ccbd222a4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:52.991082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:53.001241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d499a-4648-4a37-b423-0e262df783dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:53.006624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d499a-4648-4a37-b423-0e262df783dd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:53.006624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d499a-4648-4a37-b423-0e262df783dd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:53.006624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d499a-4648-4a37-b423-0e262df783dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:53.006624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d499a-4648-4a37-b423-0e262df783dd None admin] RBAC: Adding query filter params (role.id=67cb3b4802a642ae98a93929ca7b724c, user.id=8e8b14271e344d01ae1d325f47c441ff, scope.system=all) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:53.006624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d499a-4648-4a37-b423-0e262df783dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:53.006624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d499a-4648-4a37-b423-0e262df783dd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:53.028225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 165/334] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jun 2 09:53:52 2022] GET /identity/v3/role_assignments?user.id=8e8b14271e344d01ae1d325f47c441ff&scope.system=all&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:54.709911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0115-2d02-4b27-b902-7fb23a845cc3 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:54.711625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0115-2d02-4b27-b902-7fb23a845cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:54.712145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a0115-2d02-4b27-b902-7fb23a845cc3 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:54.714036 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 170/335] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:54.719490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232cb0-8e7d-4f6f-87be-7fb05542c25a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:54.720352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232cb0-8e7d-4f6f-87be-7fb05542c25a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:54.720857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232cb0-8e7d-4f6f-87be-7fb05542c25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:54.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7d232cb0-8e7d-4f6f-87be-7fb05542c25a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:54.742720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7d232cb0-8e7d-4f6f-87be-7fb05542c25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:54.820244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 166/336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:54.863308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a0115-2d02-4b27-b902-7fb23a845cc3 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:54.985803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a0115-2d02-4b27-b902-7fb23a845cc3 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:54.988276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:55.026468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7ba21-1656-48d5-9662-10eda78fb1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:55.027571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7ba21-1656-48d5-9662-10eda78fb1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.027938 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7ba21-1656-48d5-9662-10eda78fb1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.028219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7ba21-1656-48d5-9662-10eda78fb1a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.043263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7ba21-1656-48d5-9662-10eda78fb1a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-81e7ba21-1656-48d5-9662-10eda78fb1a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:55.053437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:55.054360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 09:53:55.055146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:55.055785 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 171/337] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:55.061118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d232cb0-8e7d-4f6f-87be-7fb05542c25a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.184226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d232cb0-8e7d-4f6f-87be-7fb05542c25a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:55.191835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:55.237346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a7129-2c3e-4444-9d43-537f2972ff9a None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.237639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a7129-2c3e-4444-9d43-537f2972ff9a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.237828 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a7129-2c3e-4444-9d43-537f2972ff9a None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.239468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 172/338] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:55.246172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471cf9-df3b-4984-a745-19d1b8681a50 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.246461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471cf9-df3b-4984-a745-19d1b8681a50 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.246744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80471cf9-df3b-4984-a745-19d1b8681a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.272198 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-80471cf9-df3b-4984-a745-19d1b8681a50 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:55.273534 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-80471cf9-df3b-4984-a745-19d1b8681a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:55.332883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a40bb7-6fb7-4976-986f-7a473512e978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:55.333563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a40bb7-6fb7-4976-986f-7a473512e978 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.333849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a40bb7-6fb7-4976-986f-7a473512e978 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.334129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a40bb7-6fb7-4976-986f-7a473512e978 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.334893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a40bb7-6fb7-4976-986f-7a473512e978 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:55.335417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a40bb7-6fb7-4976-986f-7a473512e978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:55.340901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a40bb7-6fb7-4976-986f-7a473512e978 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:55.357466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 167/339] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:55.359048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed5dc7-2959-4fd7-b1c9-a729f7829134 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.363470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed5dc7-2959-4fd7-b1c9-a729f7829134 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.364386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed5dc7-2959-4fd7-b1c9-a729f7829134 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.365959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 168/340] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:55.369916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed5dc7-2959-4fd7-b1c9-a729f7829134 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.424494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 173/341] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:53:55.426134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334c28-0020-4bd1-8cc2-502e33a54a4c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.426597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334c28-0020-4bd1-8cc2-502e33a54a4c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.427771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e334c28-0020-4bd1-8cc2-502e33a54a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.457465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7e334c28-0020-4bd1-8cc2-502e33a54a4c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:55.462487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7e334c28-0020-4bd1-8cc2-502e33a54a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:55.574740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 174/342] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:55.579706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334c28-0020-4bd1-8cc2-502e33a54a4c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.589431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed5dc7-2959-4fd7-b1c9-a729f7829134 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:55.610651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:55.647227 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65539603-24a6-4321-bca1-ceb84c97e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:55.648997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65539603-24a6-4321-bca1-ceb84c97e588 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.650237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65539603-24a6-4321-bca1-ceb84c97e588 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.650237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65539603-24a6-4321-bca1-ceb84c97e588 None admin] PATH_INFO: `/v3/users/92d3d6cab46043d98e71efb69ea2f98d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.652938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65539603-24a6-4321-bca1-ceb84c97e588 None admin] RBAC: Authorizing `identity:get_user(user_id=92d3d6cab46043d98e71efb69ea2f98d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:55.654444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65539603-24a6-4321-bca1-ceb84c97e588 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:55.656245 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 169/343] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/users/92d3d6cab46043d98e71efb69ea2f98d => generated 293 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:55.657058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65539603-24a6-4321-bca1-ceb84c97e588 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.750562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:55.766347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e334c28-0020-4bd1-8cc2-502e33a54a4c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:55.833373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af9aab-1f08-433d-93de-3c2000a56670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:55.834500 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9aab-1f08-433d-93de-3c2000a56670 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.834969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9aab-1f08-433d-93de-3c2000a56670 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.836040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9aab-1f08-433d-93de-3c2000a56670 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.861650 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65539603-24a6-4321-bca1-ceb84c97e588 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:55.862329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af9aab-1f08-433d-93de-3c2000a56670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-99af9aab-1f08-433d-93de-3c2000a56670 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:55.874685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:55.875642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:55.876435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:55.881519 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 175/344] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:55.882903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af9aab-1f08-433d-93de-3c2000a56670 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:55.920250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d6da7-b2bb-445e-88c3-ed6a78bd6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:55.921060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d6da7-b2bb-445e-88c3-ed6a78bd6646 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:55.921347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d6da7-b2bb-445e-88c3-ed6a78bd6646 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:55.921624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d6da7-b2bb-445e-88c3-ed6a78bd6646 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:55.934706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d6da7-b2bb-445e-88c3-ed6a78bd6646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-f71d6da7-b2bb-445e-88c3-ed6a78bd6646 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:55.943831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:55.945447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:55.946270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 170/345] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:55.946924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d6da7-b2bb-445e-88c3-ed6a78bd6646 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.039130 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.067765 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af9aab-1f08-433d-93de-3c2000a56670 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.116634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbe94e-c27c-496a-9a25-314f6d5ee24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.117846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbe94e-c27c-496a-9a25-314f6d5ee24a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.118136 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbe94e-c27c-496a-9a25-314f6d5ee24a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.118674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbe94e-c27c-496a-9a25-314f6d5ee24a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.120918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.121987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbe94e-c27c-496a-9a25-314f6d5ee24a None admin] RBAC: Adding query filter params (role.id=df5600f31e7047b992c20706ac525a2e, user.id=92d3d6cab46043d98e71efb69ea2f98d, scope.system=all) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:56.122320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbe94e-c27c-496a-9a25-314f6d5ee24a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.124117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbe94e-c27c-496a-9a25-314f6d5ee24a None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.129307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d6da7-b2bb-445e-88c3-ed6a78bd6646 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.142858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 176/346] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/role_assignments?user.id=92d3d6cab46043d98e71efb69ea2f98d&scope.system=all&role.id=df5600f31e7047b992c20706ac525a2e => generated 510 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:56.143556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbe94e-c27c-496a-9a25-314f6d5ee24a None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.175823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b84b66-bcd6-471f-898d-7dfd969fa729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.176525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b84b66-bcd6-471f-898d-7dfd969fa729 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.176808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b84b66-bcd6-471f-898d-7dfd969fa729 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.177088 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b84b66-bcd6-471f-898d-7dfd969fa729 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.177995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b84b66-bcd6-471f-898d-7dfd969fa729 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:56.178309 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b84b66-bcd6-471f-898d-7dfd969fa729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.180673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b84b66-bcd6-471f-898d-7dfd969fa729 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.193096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 171/347] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:56.194549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72eaf0-f608-4c24-b89a-841a449fd19e None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.194881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72eaf0-f608-4c24-b89a-841a449fd19e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.195384 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72eaf0-f608-4c24-b89a-841a449fd19e None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.197128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 172/348] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:56.198393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72eaf0-f608-4c24-b89a-841a449fd19e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.288608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbe94e-c27c-496a-9a25-314f6d5ee24a None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.328017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72eaf0-f608-4c24-b89a-841a449fd19e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.339769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ffe15-c68d-4756-8aa9-395d21c57a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.341056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ffe15-c68d-4756-8aa9-395d21c57a74 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.341418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ffe15-c68d-4756-8aa9-395d21c57a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.341773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ffe15-c68d-4756-8aa9-395d21c57a74 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.343221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ffe15-c68d-4756-8aa9-395d21c57a74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:56.343694 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ffe15-c68d-4756-8aa9-395d21c57a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.345413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ffe15-c68d-4756-8aa9-395d21c57a74 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.358975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 177/349] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:56.360592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a41718-045c-4053-b691-83d0c7f40697 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.361308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a41718-045c-4053-b691-83d0c7f40697 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.361601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a41718-045c-4053-b691-83d0c7f40697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.372269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.373363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a246781-0a2e-4a07-959e-94d2282d2c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.374036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a246781-0a2e-4a07-959e-94d2282d2c07 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.374321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a246781-0a2e-4a07-959e-94d2282d2c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.374597 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a246781-0a2e-4a07-959e-94d2282d2c07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.388957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c3a41718-045c-4053-b691-83d0c7f40697 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:56.390841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c3a41718-045c-4053-b691-83d0c7f40697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:56.421602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.479832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 178/350] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:56.480769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a41718-045c-4053-b691-83d0c7f40697 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.517326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a246781-0a2e-4a07-959e-94d2282d2c07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.518803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a246781-0a2e-4a07-959e-94d2282d2c07 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.598554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a41718-045c-4053-b691-83d0c7f40697 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.629421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 173/351] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:53:56.630197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a246781-0a2e-4a07-959e-94d2282d2c07 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.637950 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c2f75-0041-4c25-ae69-b0c215cffe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.638619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2f75-0041-4c25-ae69-b0c215cffe82 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.638910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2f75-0041-4c25-ae69-b0c215cffe82 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.639231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c2f75-0041-4c25-ae69-b0c215cffe82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.643889 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.716871 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.729822 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c2f75-0041-4c25-ae69-b0c215cffe82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:56.731306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c2f75-0041-4c25-ae69-b0c215cffe82 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:56.778551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a246781-0a2e-4a07-959e-94d2282d2c07 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.826639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ef9ca-8fb3-4584-98e3-117bf0c72b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:56.827453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ef9ca-8fb3-4584-98e3-117bf0c72b3a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:56.827770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ef9ca-8fb3-4584-98e3-117bf0c72b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:56.828048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ef9ca-8fb3-4584-98e3-117bf0c72b3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:56.843331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ef9ca-8fb3-4584-98e3-117bf0c72b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-1b1ef9ca-8fb3-4584-98e3-117bf0c72b3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:56.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:56.858558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 174/352] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:56.860537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ef9ca-8fb3-4584-98e3-117bf0c72b3a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.868487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 179/353] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:56.869808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c2f75-0041-4c25-ae69-b0c215cffe82 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:56.923420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:56.990483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ef9ca-8fb3-4584-98e3-117bf0c72b3a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:56.996887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c2f75-0041-4c25-ae69-b0c215cffe82 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.016068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.030934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9768e-9522-4761-88dd-f38186b5202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.031967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9768e-9522-4761-88dd-f38186b5202c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.032262 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9768e-9522-4761-88dd-f38186b5202c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.032549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9768e-9522-4761-88dd-f38186b5202c None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.033985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9768e-9522-4761-88dd-f38186b5202c None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.035553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9768e-9522-4761-88dd-f38186b5202c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.038977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 175/354] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.039339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9768e-9522-4761-88dd-f38186b5202c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.039902 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228ae45-cb2d-4780-a20f-a32778628701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.040846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228ae45-cb2d-4780-a20f-a32778628701 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.041305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228ae45-cb2d-4780-a20f-a32778628701 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.041774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228ae45-cb2d-4780-a20f-a32778628701 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.042723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228ae45-cb2d-4780-a20f-a32778628701 None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:57.043211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228ae45-cb2d-4780-a20f-a32778628701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.044846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228ae45-cb2d-4780-a20f-a32778628701 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.055246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 180/355] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:53:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.056389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228ae45-cb2d-4780-a20f-a32778628701 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.162005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9768e-9522-4761-88dd-f38186b5202c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.165415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.173323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228ae45-cb2d-4780-a20f-a32778628701 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.206192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ddcc-d2ff-4f41-82fc-9ae9fd0e822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.207378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ddcc-d2ff-4f41-82fc-9ae9fd0e822a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.207708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ddcc-d2ff-4f41-82fc-9ae9fd0e822a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.207989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ddcc-d2ff-4f41-82fc-9ae9fd0e822a None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.209592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9ddcc-d2ff-4f41-82fc-9ae9fd0e822a None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.211563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9ddcc-d2ff-4f41-82fc-9ae9fd0e822a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.213291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 176/356] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.214055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ddcc-d2ff-4f41-82fc-9ae9fd0e822a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.217013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e23a9-9729-45b1-9931-7272b97e40c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.218195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e23a9-9729-45b1-9931-7272b97e40c1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.218556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e23a9-9729-45b1-9931-7272b97e40c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.218838 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e23a9-9729-45b1-9931-7272b97e40c1 None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.230875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e23a9-9729-45b1-9931-7272b97e40c1 None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.232518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e23a9-9729-45b1-9931-7272b97e40c1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.234568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 181/357] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.235840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd3fb1-2667-4913-9897-0da7dfc22d3f None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.236133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd3fb1-2667-4913-9897-0da7dfc22d3f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.236417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd3fb1-2667-4913-9897-0da7dfc22d3f None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.237659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 182/358] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:57.238362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd3fb1-2667-4913-9897-0da7dfc22d3f None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.285450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.340820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ddcc-d2ff-4f41-82fc-9ae9fd0e822a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.368937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd3fb1-2667-4913-9897-0da7dfc22d3f None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.381003 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25bd886-aed0-4e58-88c1-0e8c6d9efcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.382962 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bd886-aed0-4e58-88c1-0e8c6d9efcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.383255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bd886-aed0-4e58-88c1-0e8c6d9efcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.383537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25bd886-aed0-4e58-88c1-0e8c6d9efcf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.415979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7efea-5a49-4ea5-b3a9-31dfa3e7398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.417016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7efea-5a49-4ea5-b3a9-31dfa3e7398a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.417311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7efea-5a49-4ea5-b3a9-31dfa3e7398a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.417595 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7efea-5a49-4ea5-b3a9-31dfa3e7398a None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.419172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7efea-5a49-4ea5-b3a9-31dfa3e7398a None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.420847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7efea-5a49-4ea5-b3a9-31dfa3e7398a None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.422519 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 183/359] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.423280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7efea-5a49-4ea5-b3a9-31dfa3e7398a None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.461156 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.476143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bd886-aed0-4e58-88c1-0e8c6d9efcf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.477884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25bd886-aed0-4e58-88c1-0e8c6d9efcf5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.549318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.553447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7efea-5a49-4ea5-b3a9-31dfa3e7398a None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.594361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5eaad-a6ea-4980-96d4-9e03546a7747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.594361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5eaad-a6ea-4980-96d4-9e03546a7747 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.594361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5eaad-a6ea-4980-96d4-9e03546a7747 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.594724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5eaad-a6ea-4980-96d4-9e03546a7747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.595424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5eaad-a6ea-4980-96d4-9e03546a7747 None admin] RBAC: Adding query filter params (group.id=282660734c8a4ffa97401cb5ee4864a4, role.id=d98e80f5e9c34378bf50e810e4b8a210, scope.project.id=18750bb94664432fadddf1a1dadc20f6) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:57.595813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5eaad-a6ea-4980-96d4-9e03546a7747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.597259 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5eaad-a6ea-4980-96d4-9e03546a7747 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.603197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 177/360] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:57.603826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06050f-d8a4-4ee5-96ce-c6e7aca4f97e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.604121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06050f-d8a4-4ee5-96ce-c6e7aca4f97e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.604402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06050f-d8a4-4ee5-96ce-c6e7aca4f97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.605482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 184/361] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/role_assignments?group.id=282660734c8a4ffa97401cb5ee4864a4&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=d98e80f5e9c34378bf50e810e4b8a210 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.606719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5eaad-a6ea-4980-96d4-9e03546a7747 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.624026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2d06050f-d8a4-4ee5-96ce-c6e7aca4f97e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:57.625597 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2d06050f-d8a4-4ee5-96ce-c6e7aca4f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:57.728567 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 178/362] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:57.730377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5a058-e0f4-4e1f-981f-82f48a165005 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.731016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5a058-e0f4-4e1f-981f-82f48a165005 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.731296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5a058-e0f4-4e1f-981f-82f48a165005 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.732976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 179/363] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:53:57.737582 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.738956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5a058-e0f4-4e1f-981f-82f48a165005 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.745504 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5eaad-a6ea-4980-96d4-9e03546a7747 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.786965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d34da-2e71-4f5d-b15e-ddc0bcadca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.787706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d34da-2e71-4f5d-b15e-ddc0bcadca20 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.787996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d34da-2e71-4f5d-b15e-ddc0bcadca20 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.788385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d34da-2e71-4f5d-b15e-ddc0bcadca20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.791383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d34da-2e71-4f5d-b15e-ddc0bcadca20 None admin] RBAC: Adding query filter params (group.id=282660734c8a4ffa97401cb5ee4864a4, role.id=67cb3b4802a642ae98a93929ca7b724c, scope.project.id=18750bb94664432fadddf1a1dadc20f6) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:57.791383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d34da-2e71-4f5d-b15e-ddc0bcadca20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.791383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d34da-2e71-4f5d-b15e-ddc0bcadca20 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.798405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 185/364] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/role_assignments?group.id=282660734c8a4ffa97401cb5ee4864a4&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.799743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4c9c-780c-443c-865d-1b26befb852b None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.800035 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4c9c-780c-443c-865d-1b26befb852b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.800311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4c9c-780c-443c-865d-1b26befb852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.822157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-667d4c9c-780c-443c-865d-1b26befb852b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:53:57.823386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-667d4c9c-780c-443c-865d-1b26befb852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:53:57.860696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:57.885274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5a058-e0f4-4e1f-981f-82f48a165005 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:57.934651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3026d-f086-4486-80bf-14c0a997ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:57.937303 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3026d-f086-4486-80bf-14c0a997ea17 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:57.937910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3026d-f086-4486-80bf-14c0a997ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:57.938391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3026d-f086-4486-80bf-14c0a997ea17 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:57.939732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 186/365] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:53:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:53:57.940677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3026d-f086-4486-80bf-14c0a997ea17 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:57.940811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d4c9c-780c-443c-865d-1b26befb852b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:57.942542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3026d-f086-4486-80bf-14c0a997ea17 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:57.944763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 180/366] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:57.951361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3026d-f086-4486-80bf-14c0a997ea17 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:58.085471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:58.098053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d4c9c-780c-443c-865d-1b26befb852b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.117800 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3026d-f086-4486-80bf-14c0a997ea17 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.141768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352185d-1352-4086-87d1-81468955925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.142877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352185d-1352-4086-87d1-81468955925c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.143368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352185d-1352-4086-87d1-81468955925c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.143866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352185d-1352-4086-87d1-81468955925c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.158717 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352185d-1352-4086-87d1-81468955925c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:58.168293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f1ff0-d9ab-4d3b-903f-e6412200f9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-f352185d-1352-4086-87d1-81468955925c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:58.168792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:58.169674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:58.170476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 187/367] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:58.171170 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352185d-1352-4086-87d1-81468955925c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:58.172638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f1ff0-d9ab-4d3b-903f-e6412200f9fb None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.173147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f1ff0-d9ab-4d3b-903f-e6412200f9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.173632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f1ff0-d9ab-4d3b-903f-e6412200f9fb None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.175112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f1ff0-d9ab-4d3b-903f-e6412200f9fb None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:58.176968 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f1ff0-d9ab-4d3b-903f-e6412200f9fb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:58.179907 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 181/368] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:53:57 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:58.180912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f1ff0-d9ab-4d3b-903f-e6412200f9fb None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:58.206906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:58.303154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352185d-1352-4086-87d1-81468955925c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.326012 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f1ff0-d9ab-4d3b-903f-e6412200f9fb None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.343977 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e0037-b574-4140-9ab9-2cca72dac71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.344699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e0037-b574-4140-9ab9-2cca72dac71e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.344984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e0037-b574-4140-9ab9-2cca72dac71e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.345264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e0037-b574-4140-9ab9-2cca72dac71e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.358620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e0037-b574-4140-9ab9-2cca72dac71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-750e0037-b574-4140-9ab9-2cca72dac71e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:53:58.367371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:53:58.368352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:53:58.369144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 188/369] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:53:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:53:58.369815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e0037-b574-4140-9ab9-2cca72dac71e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:58.373526 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb4a35-c708-4f19-83df-aa99a37db6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.374463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4a35-c708-4f19-83df-aa99a37db6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.375019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4a35-c708-4f19-83df-aa99a37db6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.375519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb4a35-c708-4f19-83df-aa99a37db6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.377194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb4a35-c708-4f19-83df-aa99a37db6c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:58.378365 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb4a35-c708-4f19-83df-aa99a37db6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:58.381479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb4a35-c708-4f19-83df-aa99a37db6c0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:58.386143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:58.394958 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 182/370] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:53:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:58.396274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb4a35-c708-4f19-83df-aa99a37db6c0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:58.495214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:58.495540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e0037-b574-4140-9ab9-2cca72dac71e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.516747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb4a35-c708-4f19-83df-aa99a37db6c0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.532194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd43d1-d813-4dca-a1fb-299c5efd6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.532873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd43d1-d813-4dca-a1fb-299c5efd6648 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.533155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd43d1-d813-4dca-a1fb-299c5efd6648 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.533432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd43d1-d813-4dca-a1fb-299c5efd6648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.534271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd43d1-d813-4dca-a1fb-299c5efd6648 None admin] RBAC: Adding query filter params (group.id=282660734c8a4ffa97401cb5ee4864a4, role.id=67cb3b4802a642ae98a93929ca7b724c, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:58.534628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd43d1-d813-4dca-a1fb-299c5efd6648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:58.536044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd43d1-d813-4dca-a1fb-299c5efd6648 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:58.541961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 189/371] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 2 09:53:58 2022] GET /identity/v3/role_assignments?group.id=282660734c8a4ffa97401cb5ee4864a4&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:58.543092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd43d1-d813-4dca-a1fb-299c5efd6648 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:58.568395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b14fe6-c1fb-4b4d-823e-44eed0711bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.572008 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b14fe6-c1fb-4b4d-823e-44eed0711bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.572657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b14fe6-c1fb-4b4d-823e-44eed0711bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.573144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b14fe6-c1fb-4b4d-823e-44eed0711bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.574138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b14fe6-c1fb-4b4d-823e-44eed0711bc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:58.574987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b14fe6-c1fb-4b4d-823e-44eed0711bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:58.580908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b14fe6-c1fb-4b4d-823e-44eed0711bc5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:58.595274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 183/372] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:53:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:58.603541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b14fe6-c1fb-4b4d-823e-44eed0711bc5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:58.707171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:58.766839 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd43d1-d813-4dca-a1fb-299c5efd6648 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.798916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b14fe6-c1fb-4b4d-823e-44eed0711bc5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:58.843233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a063e6-1846-453a-abe2-1fd784dcf413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.843941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a063e6-1846-453a-abe2-1fd784dcf413 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.844227 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a063e6-1846-453a-abe2-1fd784dcf413 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.844508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a063e6-1846-453a-abe2-1fd784dcf413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.848525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74bf48-0a3a-4bb6-b498-1a28df3c5dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:58.849138 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74bf48-0a3a-4bb6-b498-1a28df3c5dbc None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:58.849429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74bf48-0a3a-4bb6-b498-1a28df3c5dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:58.849709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74bf48-0a3a-4bb6-b498-1a28df3c5dbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:58.879954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:58.966260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74bf48-0a3a-4bb6-b498-1a28df3c5dbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:58.967761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74bf48-0a3a-4bb6-b498-1a28df3c5dbc None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:58.978218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a063e6-1846-453a-abe2-1fd784dcf413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:58.980262 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a063e6-1846-453a-abe2-1fd784dcf413 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:59.046430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:59.080711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 190/373] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:59.086806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74bf48-0a3a-4bb6-b498-1a28df3c5dbc None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.183196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 184/374] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:53:59.195467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74bf48-0a3a-4bb6-b498-1a28df3c5dbc None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:59.197373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a063e6-1846-453a-abe2-1fd784dcf413 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.231451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71dc0c-e019-4ad6-b21e-a9400cdc960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:59.232348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71dc0c-e019-4ad6-b21e-a9400cdc960f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.232632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71dc0c-e019-4ad6-b21e-a9400cdc960f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.232912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71dc0c-e019-4ad6-b21e-a9400cdc960f None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.234108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71dc0c-e019-4ad6-b21e-a9400cdc960f None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:59.235543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71dc0c-e019-4ad6-b21e-a9400cdc960f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:59.242330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 191/375] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:59 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:59.243205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71dc0c-e019-4ad6-b21e-a9400cdc960f None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.290892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:59.317519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:59.352638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71dc0c-e019-4ad6-b21e-a9400cdc960f None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:59.394209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d94b9-e3a9-406f-8552-116ae69e2502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:59.395076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d94b9-e3a9-406f-8552-116ae69e2502 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.395361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d94b9-e3a9-406f-8552-116ae69e2502 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.395661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d94b9-e3a9-406f-8552-116ae69e2502 None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.398694 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d94b9-e3a9-406f-8552-116ae69e2502 None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:59.400387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d94b9-e3a9-406f-8552-116ae69e2502 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:59.403271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 192/376] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:53:59 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:59.411183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d94b9-e3a9-406f-8552-116ae69e2502 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.444136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a063e6-1846-453a-abe2-1fd784dcf413 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:59.516525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06546b33-7ed2-4437-8336-dda427a24df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:59.517393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06546b33-7ed2-4437-8336-dda427a24df3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.517676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06546b33-7ed2-4437-8336-dda427a24df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.517949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06546b33-7ed2-4437-8336-dda427a24df3 None admin] PATH_INFO: `/v3/projects/76cf5bbc77b94e4aad5326febc250cf3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.519826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06546b33-7ed2-4437-8336-dda427a24df3 None admin] RBAC: Authorizing `identity:get_project(project_id=76cf5bbc77b94e4aad5326febc250cf3)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:59.521349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06546b33-7ed2-4437-8336-dda427a24df3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:59.527835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 185/377] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:53:59 2022] GET /identity/v3/projects/76cf5bbc77b94e4aad5326febc250cf3 => generated 344 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:59.533405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06546b33-7ed2-4437-8336-dda427a24df3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.589060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d94b9-e3a9-406f-8552-116ae69e2502 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:59.600124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:59.658408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0cf3b-dc89-4dd5-89c1-dde86377acea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:59.659066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0cf3b-dc89-4dd5-89c1-dde86377acea None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.659352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0cf3b-dc89-4dd5-89c1-dde86377acea None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.659650 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0cf3b-dc89-4dd5-89c1-dde86377acea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.660494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0cf3b-dc89-4dd5-89c1-dde86377acea None admin] RBAC: Adding query filter params (group.id=282660734c8a4ffa97401cb5ee4864a4, role.id=d98e80f5e9c34378bf50e810e4b8a210, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:59.660811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0cf3b-dc89-4dd5-89c1-dde86377acea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:59.662256 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0cf3b-dc89-4dd5-89c1-dde86377acea None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:59.674384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 193/378] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 2 09:53:59 2022] GET /identity/v3/role_assignments?group.id=282660734c8a4ffa97401cb5ee4864a4&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=d98e80f5e9c34378bf50e810e4b8a210 => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:53:59.723138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06546b33-7ed2-4437-8336-dda427a24df3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:59.740640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:53:59.768651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc514ec-c3cf-4977-9a4f-c434eb3a706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:59.769522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc514ec-c3cf-4977-9a4f-c434eb3a706c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.769810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc514ec-c3cf-4977-9a4f-c434eb3a706c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.770089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc514ec-c3cf-4977-9a4f-c434eb3a706c None admin] PATH_INFO: `/v3/groups/a61ae393668f45c6832933b601fb25d0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.779997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc514ec-c3cf-4977-9a4f-c434eb3a706c None admin] RBAC: Authorizing `identity:get_group(group_id=a61ae393668f45c6832933b601fb25d0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:59.781814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc514ec-c3cf-4977-9a4f-c434eb3a706c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:59.783992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 186/379] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:53:59 2022] GET /identity/v3/groups/a61ae393668f45c6832933b601fb25d0 => generated 229 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:53:59.790144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0cf3b-dc89-4dd5-89c1-dde86377acea None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:53:59.932919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0cf3b-dc89-4dd5-89c1-dde86377acea None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:53:59.971288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9853c8-1708-436c-a16f-4c4a1a2fc648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:53:59.972060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9853c8-1708-436c-a16f-4c4a1a2fc648 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:53:59.972291 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9853c8-1708-436c-a16f-4c4a1a2fc648 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:53:59.972833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9853c8-1708-436c-a16f-4c4a1a2fc648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:53:59.973730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9853c8-1708-436c-a16f-4c4a1a2fc648 None admin] RBAC: Adding query filter params (group.id=a61ae393668f45c6832933b601fb25d0, role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=76cf5bbc77b94e4aad5326febc250cf3) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:53:59.973994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9853c8-1708-436c-a16f-4c4a1a2fc648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:53:59.975525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9853c8-1708-436c-a16f-4c4a1a2fc648 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:53:59.983010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 194/380] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 2 09:53:59 2022] GET /identity/v3/role_assignments?group.id=a61ae393668f45c6832933b601fb25d0&scope.project.id=76cf5bbc77b94e4aad5326febc250cf3&role.id=918b179f19b6437493eabe5394fa9af0 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:00.549920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245960e-a72e-4159-b769-d7e47f0ad753 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.550423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245960e-a72e-4159-b769-d7e47f0ad753 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.550497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245960e-a72e-4159-b769-d7e47f0ad753 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.552211 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 187/381] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:00.558256 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7d52c-6737-4bed-8436-28d1761917c3 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.558550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7d52c-6737-4bed-8436-28d1761917c3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.558829 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7d52c-6737-4bed-8436-28d1761917c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.581750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-9fe7d52c-6737-4bed-8436-28d1761917c3 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:00.582943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9fe7d52c-6737-4bed-8436-28d1761917c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:00.611406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:00.658490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 195/382] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:00.701878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245960e-a72e-4159-b769-d7e47f0ad753 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:00.848204 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245960e-a72e-4159-b769-d7e47f0ad753 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:00.871670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915be605-600a-4208-a70d-e77e3f6d03cd None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.871670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915be605-600a-4208-a70d-e77e3f6d03cd None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.871670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915be605-600a-4208-a70d-e77e3f6d03cd None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.871670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 196/383] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:00.873242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2447e-810e-4dc9-90b6-160142fdc704 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.873532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2447e-810e-4dc9-90b6-160142fdc704 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.873818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2447e-810e-4dc9-90b6-160142fdc704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.898732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f5a2447e-810e-4dc9-90b6-160142fdc704 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:00.900154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f5a2447e-810e-4dc9-90b6-160142fdc704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:00.906395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae1b1f-3f78-434e-ba2f-5b7fb91fc46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:00.907217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1b1f-3f78-434e-ba2f-5b7fb91fc46d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:00.907504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1b1f-3f78-434e-ba2f-5b7fb91fc46d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:00.907811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1b1f-3f78-434e-ba2f-5b7fb91fc46d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:00.930285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae1b1f-3f78-434e-ba2f-5b7fb91fc46d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-b2ae1b1f-3f78-434e-ba2f-5b7fb91fc46d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:00.938590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:00.939692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:00.940654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:00.941408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 188/384] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:00.948469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae1b1f-3f78-434e-ba2f-5b7fb91fc46d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.021489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 197/385] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:01.029092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:01.052840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2447e-810e-4dc9-90b6-160142fdc704 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.153645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae1b1f-3f78-434e-ba2f-5b7fb91fc46d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:01.224227 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06531c5f-5fe2-4363-801c-9a27787940f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.225016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06531c5f-5fe2-4363-801c-9a27787940f6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.225306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06531c5f-5fe2-4363-801c-9a27787940f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.226130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06531c5f-5fe2-4363-801c-9a27787940f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.226976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06531c5f-5fe2-4363-801c-9a27787940f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:01.227290 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06531c5f-5fe2-4363-801c-9a27787940f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:01.231276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06531c5f-5fe2-4363-801c-9a27787940f6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:01.238359 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:01.251473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2447e-810e-4dc9-90b6-160142fdc704 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:01.253282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 189/386] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:01.259103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06531c5f-5fe2-4363-801c-9a27787940f6 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.324507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2147d3c-1b87-4908-bfbb-37444affe2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.325315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147d3c-1b87-4908-bfbb-37444affe2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.325601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147d3c-1b87-4908-bfbb-37444affe2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.325990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147d3c-1b87-4908-bfbb-37444affe2a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.346083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2147d3c-1b87-4908-bfbb-37444affe2a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-b2147d3c-1b87-4908-bfbb-37444affe2a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:01.362561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:01.363503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:01.364360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 198/387] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:01.370469 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2147d3c-1b87-4908-bfbb-37444affe2a2 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.428005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:01.431070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06531c5f-5fe2-4363-801c-9a27787940f6 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:01.472863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb12ad2-e8c6-42da-9e4c-0a7bc843e96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.473751 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb12ad2-e8c6-42da-9e4c-0a7bc843e96e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.474040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb12ad2-e8c6-42da-9e4c-0a7bc843e96e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.474320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb12ad2-e8c6-42da-9e4c-0a7bc843e96e None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.475897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb12ad2-e8c6-42da-9e4c-0a7bc843e96e None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:01.477876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb12ad2-e8c6-42da-9e4c-0a7bc843e96e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:01.481588 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 190/388] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:01 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:01.482880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283cb4e-85d9-47d8-a5cd-e7afdd1f5d61 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.483175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283cb4e-85d9-47d8-a5cd-e7afdd1f5d61 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.483460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283cb4e-85d9-47d8-a5cd-e7afdd1f5d61 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.484751 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 191/389] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:01.490422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283cb4e-85d9-47d8-a5cd-e7afdd1f5d61 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.507791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2147d3c-1b87-4908-bfbb-37444affe2a2 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:01.544514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd00c40-5131-428a-aa29-4e57adb9b75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.545195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd00c40-5131-428a-aa29-4e57adb9b75c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.545479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd00c40-5131-428a-aa29-4e57adb9b75c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.545759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd00c40-5131-428a-aa29-4e57adb9b75c None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.546517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd00c40-5131-428a-aa29-4e57adb9b75c None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:01.546834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd00c40-5131-428a-aa29-4e57adb9b75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:01.548247 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd00c40-5131-428a-aa29-4e57adb9b75c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:01.558258 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 199/390] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:01.559554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2208f18-e061-491f-9466-ea856a53ca05 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.559869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2208f18-e061-491f-9466-ea856a53ca05 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.560283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2208f18-e061-491f-9466-ea856a53ca05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.578373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f2208f18-e061-491f-9466-ea856a53ca05 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:01.579605 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f2208f18-e061-491f-9466-ea856a53ca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:01.591814 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:01.608881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283cb4e-85d9-47d8-a5cd-e7afdd1f5d61 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:01.654061 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5450ae0-f55d-4867-aaf5-f5c827f731ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.654930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5450ae0-f55d-4867-aaf5-f5c827f731ef None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.655307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5450ae0-f55d-4867-aaf5-f5c827f731ef None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.655714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5450ae0-f55d-4867-aaf5-f5c827f731ef None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.656927 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5450ae0-f55d-4867-aaf5-f5c827f731ef None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:01.658395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5450ae0-f55d-4867-aaf5-f5c827f731ef None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:01.658521 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 200/391] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:01.659405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2208f18-e061-491f-9466-ea856a53ca05 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.660147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 192/392] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:01 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:01.669111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5450ae0-f55d-4867-aaf5-f5c827f731ef None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.718758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:01.791789 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5450ae0-f55d-4867-aaf5-f5c827f731ef None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:01.817509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2208f18-e061-491f-9466-ea856a53ca05 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:01.831765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad1293-3b6c-46b0-aea5-ddd7ca36233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.832658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad1293-3b6c-46b0-aea5-ddd7ca36233c None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.832941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad1293-3b6c-46b0-aea5-ddd7ca36233c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.833219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad1293-3b6c-46b0-aea5-ddd7ca36233c None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6/groups/282660734c8a4ffa97401cb5ee4864a4/roles/d98e80f5e9c34378bf50e810e4b8a210` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.836075 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad1293-3b6c-46b0-aea5-ddd7ca36233c None admin] RBAC: Authorizing `identity:create_grant(project_id=18750bb94664432fadddf1a1dadc20f6, group_id=282660734c8a4ffa97401cb5ee4864a4, role_id=d98e80f5e9c34378bf50e810e4b8a210)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:01.837538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad1293-3b6c-46b0-aea5-ddd7ca36233c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:01.861664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7008ae0-da5d-4149-ae6a-fd4659c621e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:01.862540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7008ae0-da5d-4149-ae6a-fd4659c621e9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:01.862827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7008ae0-da5d-4149-ae6a-fd4659c621e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:01.863105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7008ae0-da5d-4149-ae6a-fd4659c621e9 None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:01.864326 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7008ae0-da5d-4149-ae6a-fd4659c621e9 None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:01.865914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7008ae0-da5d-4149-ae6a-fd4659c621e9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:01.868266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 201/393] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:01 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:01.868949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7008ae0-da5d-4149-ae6a-fd4659c621e9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:01.887003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:01.917100 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 193/394] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jun 2 09:54:01 2022] PUT /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6/groups/282660734c8a4ffa97401cb5ee4864a4/roles/d98e80f5e9c34378bf50e810e4b8a210 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:01.924608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad1293-3b6c-46b0-aea5-ddd7ca36233c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:02.002469 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7008ae0-da5d-4149-ae6a-fd4659c621e9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:02.045364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816651e-fb48-4e3b-a77c-87e686682383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:02.046234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816651e-fb48-4e3b-a77c-87e686682383 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.046834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816651e-fb48-4e3b-a77c-87e686682383 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.047294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816651e-fb48-4e3b-a77c-87e686682383 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.060577 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816651e-fb48-4e3b-a77c-87e686682383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-5816651e-fb48-4e3b-a77c-87e686682383 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:02.070129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:02.071097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:02.071974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:02.075016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 202/395] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:02.081641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816651e-fb48-4e3b-a77c-87e686682383 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:02.173843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:02.189537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:02.198256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad1293-3b6c-46b0-aea5-ddd7ca36233c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:02.204712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816651e-fb48-4e3b-a77c-87e686682383 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:02.238267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2690f8-10fc-4ffc-9931-bc7826094dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:02.239033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2690f8-10fc-4ffc-9931-bc7826094dfd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.239319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2690f8-10fc-4ffc-9931-bc7826094dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.239742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2690f8-10fc-4ffc-9931-bc7826094dfd None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.241513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2690f8-10fc-4ffc-9931-bc7826094dfd None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:02.243213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2690f8-10fc-4ffc-9931-bc7826094dfd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:02.245033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 194/396] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:01 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:02.250329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcd018-ed69-4008-899e-e9b44a5fae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:02.250956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2690f8-10fc-4ffc-9931-bc7826094dfd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:02.251549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcd018-ed69-4008-899e-e9b44a5fae3c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.252043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcd018-ed69-4008-899e-e9b44a5fae3c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.252648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcd018-ed69-4008-899e-e9b44a5fae3c None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.253603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcd018-ed69-4008-899e-e9b44a5fae3c None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:02.254154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcd018-ed69-4008-899e-e9b44a5fae3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:02.255771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcd018-ed69-4008-899e-e9b44a5fae3c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:02.266322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 203/397] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:02.272660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcd018-ed69-4008-899e-e9b44a5fae3c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:02.363155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2690f8-10fc-4ffc-9931-bc7826094dfd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:02.382267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcd018-ed69-4008-899e-e9b44a5fae3c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:02.399235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0383e14-a4b4-4f38-97f3-9292e311c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:02.400155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0383e14-a4b4-4f38-97f3-9292e311c756 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.400442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0383e14-a4b4-4f38-97f3-9292e311c756 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.400720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0383e14-a4b4-4f38-97f3-9292e311c756 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6/groups/282660734c8a4ffa97401cb5ee4864a4/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.402987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0383e14-a4b4-4f38-97f3-9292e311c756 None admin] RBAC: Authorizing `identity:create_grant(project_id=18750bb94664432fadddf1a1dadc20f6, group_id=282660734c8a4ffa97401cb5ee4864a4, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:02.404464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0383e14-a4b4-4f38-97f3-9292e311c756 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:02.425705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e742a-11c6-44e2-8978-776e91a5523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:02.426873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e742a-11c6-44e2-8978-776e91a5523c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.427450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e742a-11c6-44e2-8978-776e91a5523c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.427982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e742a-11c6-44e2-8978-776e91a5523c None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.430840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e742a-11c6-44e2-8978-776e91a5523c None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:02.432880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e742a-11c6-44e2-8978-776e91a5523c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:02.434764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 204/398] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:02 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:02.440477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e742a-11c6-44e2-8978-776e91a5523c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:02.445771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:02.506121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 195/399] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jun 2 09:54:02 2022] PUT /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6/groups/282660734c8a4ffa97401cb5ee4864a4/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:54:02.564888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e742a-11c6-44e2-8978-776e91a5523c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:02.607768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917afd15-4cdb-4cb8-bf0e-28d6db67b1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:02.608654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917afd15-4cdb-4cb8-bf0e-28d6db67b1be None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.608946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917afd15-4cdb-4cb8-bf0e-28d6db67b1be None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.609223 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917afd15-4cdb-4cb8-bf0e-28d6db67b1be None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.617439 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917afd15-4cdb-4cb8-bf0e-28d6db67b1be None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:02.618636 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917afd15-4cdb-4cb8-bf0e-28d6db67b1be None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:02.620889 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 205/400] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:02 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:02.626892 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0383e14-a4b4-4f38-97f3-9292e311c756 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:02.641110 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a36b71-496e-4b40-8949-abe8586dba58 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.641419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a36b71-496e-4b40-8949-abe8586dba58 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.641684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a36b71-496e-4b40-8949-abe8586dba58 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.643190 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 206/401] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:02.651367 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a08ceb-5ba6-4cab-a0e9-22b3b83a5f98 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.652274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a08ceb-5ba6-4cab-a0e9-22b3b83a5f98 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.652762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a08ceb-5ba6-4cab-a0e9-22b3b83a5f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.674643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-92a08ceb-5ba6-4cab-a0e9-22b3b83a5f98 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:02.676296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-92a08ceb-5ba6-4cab-a0e9-22b3b83a5f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:02.690835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:02.767802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 207/402] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:02.797885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a08ceb-5ba6-4cab-a0e9-22b3b83a5f98 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:02.801759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:02.836720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0383e14-a4b4-4f38-97f3-9292e311c756 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:02.891604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365651c2-d221-4bb3-9e8c-2983649dd9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:02.891604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365651c2-d221-4bb3-9e8c-2983649dd9c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.891604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365651c2-d221-4bb3-9e8c-2983649dd9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.891604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365651c2-d221-4bb3-9e8c-2983649dd9c5 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/groups/282660734c8a4ffa97401cb5ee4864a4/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.892003 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365651c2-d221-4bb3-9e8c-2983649dd9c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bd52514ff434e4eaa4b9885515ae22c, group_id=282660734c8a4ffa97401cb5ee4864a4, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:02.892003 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365651c2-d221-4bb3-9e8c-2983649dd9c5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:02.931037 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a08ceb-5ba6-4cab-a0e9-22b3b83a5f98 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:02.967611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82af4f-63e8-46db-bc9c-17acbada865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:02.968447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82af4f-63e8-46db-bc9c-17acbada865b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.968733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82af4f-63e8-46db-bc9c-17acbada865b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.969003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82af4f-63e8-46db-bc9c-17acbada865b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.980170 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82af4f-63e8-46db-bc9c-17acbada865b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-cc82af4f-63e8-46db-bc9c-17acbada865b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:02.988273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:02.989176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 208/403] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:02.995132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4305b-092a-43a9-a80a-68a9935974f7 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:02.995910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4305b-092a-43a9-a80a-68a9935974f7 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:02.995910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4305b-092a-43a9-a80a-68a9935974f7 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:02.995910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 209/404] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:02.995910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4305b-092a-43a9-a80a-68a9935974f7 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.019339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 196/405] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jun 2 09:54:02 2022] PUT /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/groups/282660734c8a4ffa97401cb5ee4864a4/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:03.019339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224bff-1e03-48a5-86f2-f12c4a3ec80e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.019339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224bff-1e03-48a5-86f2-f12c4a3ec80e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.019339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20224bff-1e03-48a5-86f2-f12c4a3ec80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.055994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-20224bff-1e03-48a5-86f2-f12c4a3ec80e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:03.058355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-20224bff-1e03-48a5-86f2-f12c4a3ec80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:03.119595 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:03.204289 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4305b-092a-43a9-a80a-68a9935974f7 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.217815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 197/406] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:03.259844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306da69-c873-4125-bb43-a31131c4e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.260904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306da69-c873-4125-bb43-a31131c4e17c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.261403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306da69-c873-4125-bb43-a31131c4e17c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.261899 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306da69-c873-4125-bb43-a31131c4e17c None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.262854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306da69-c873-4125-bb43-a31131c4e17c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:03.263365 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306da69-c873-4125-bb43-a31131c4e17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:03.269069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306da69-c873-4125-bb43-a31131c4e17c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:03.269200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20224bff-1e03-48a5-86f2-f12c4a3ec80e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.281206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 210/407] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:03.286543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:03.287189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306da69-c873-4125-bb43-a31131c4e17c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.389894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20224bff-1e03-48a5-86f2-f12c4a3ec80e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.395043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306da69-c873-4125-bb43-a31131c4e17c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.419391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:03.433355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bd5b3-7159-40c9-b13a-e416795863e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.435206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bd5b3-7159-40c9-b13a-e416795863e5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.435573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bd5b3-7159-40c9-b13a-e416795863e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.435878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bd5b3-7159-40c9-b13a-e416795863e5 None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.437940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bd5b3-7159-40c9-b13a-e416795863e5 None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:03.439938 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bd5b3-7159-40c9-b13a-e416795863e5 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:03.441558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 211/408] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:03 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:03.445824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac7d2f-cdcd-417c-94ac-b14f1dc0749a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.447517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7d2f-cdcd-417c-94ac-b14f1dc0749a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.447517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7d2f-cdcd-417c-94ac-b14f1dc0749a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.447517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac7d2f-cdcd-417c-94ac-b14f1dc0749a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.450256 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bd5b3-7159-40c9-b13a-e416795863e5 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.476040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ac7d2f-cdcd-417c-94ac-b14f1dc0749a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e2ac7d2f-cdcd-417c-94ac-b14f1dc0749a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:03.493377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:03.494374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:03.495217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:03.497445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 198/409] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:03.520031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac7d2f-cdcd-417c-94ac-b14f1dc0749a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.657308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bd5b3-7159-40c9-b13a-e416795863e5 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.674393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:03.712149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac7d2f-cdcd-417c-94ac-b14f1dc0749a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.725868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c5d90-6326-4c9d-abad-deb7498d9ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.726737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c5d90-6326-4c9d-abad-deb7498d9ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.727015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c5d90-6326-4c9d-abad-deb7498d9ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.727287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c5d90-6326-4c9d-abad-deb7498d9ea9 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.729629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c5d90-6326-4c9d-abad-deb7498d9ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:03.731117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c5d90-6326-4c9d-abad-deb7498d9ea9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:03.734140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 212/410] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:03 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:03.739793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c5d90-6326-4c9d-abad-deb7498d9ea9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.778033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1c0a2-944f-4b4b-a39e-480ce9c93896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.779589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c0a2-944f-4b4b-a39e-480ce9c93896 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.780229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c0a2-944f-4b4b-a39e-480ce9c93896 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.780690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1c0a2-944f-4b4b-a39e-480ce9c93896 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.781885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1c0a2-944f-4b4b-a39e-480ce9c93896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:03.782424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1c0a2-944f-4b4b-a39e-480ce9c93896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:03.790246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1c0a2-944f-4b4b-a39e-480ce9c93896 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:03.813730 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 199/411] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:03.824635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1c0a2-944f-4b4b-a39e-480ce9c93896 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:03.833517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:03.884591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c5d90-6326-4c9d-abad-deb7498d9ea9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:03.920528 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7824e-1536-45bb-a2ef-d9cd53dd302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:03.921324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7824e-1536-45bb-a2ef-d9cd53dd302f None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:03.921605 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7824e-1536-45bb-a2ef-d9cd53dd302f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:03.921879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7824e-1536-45bb-a2ef-d9cd53dd302f None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/groups/282660734c8a4ffa97401cb5ee4864a4/roles/d98e80f5e9c34378bf50e810e4b8a210` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:03.924216 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7824e-1536-45bb-a2ef-d9cd53dd302f None admin] RBAC: Authorizing `identity:create_grant(project_id=0bd52514ff434e4eaa4b9885515ae22c, group_id=282660734c8a4ffa97401cb5ee4864a4, role_id=d98e80f5e9c34378bf50e810e4b8a210)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:03.925894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7824e-1536-45bb-a2ef-d9cd53dd302f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:04.003247 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 213/412] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jun 2 09:54:03 2022] PUT /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c/groups/282660734c8a4ffa97401cb5ee4864a4/roles/d98e80f5e9c34378bf50e810e4b8a210 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:04.013405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1c0a2-944f-4b4b-a39e-480ce9c93896 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:04.055700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bab1d8-df5d-499f-b851-774b95fd28bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:04.056735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab1d8-df5d-499f-b851-774b95fd28bb None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:04.057022 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab1d8-df5d-499f-b851-774b95fd28bb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:04.057298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bab1d8-df5d-499f-b851-774b95fd28bb None admin] PATH_INFO: `/v3/groups/a61ae393668f45c6832933b601fb25d0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.058619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bab1d8-df5d-499f-b851-774b95fd28bb None admin] RBAC: Authorizing `identity:get_group(group_id=a61ae393668f45c6832933b601fb25d0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:04.060133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bab1d8-df5d-499f-b851-774b95fd28bb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:04.062374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 200/413] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:03 2022] GET /identity/v3/groups/a61ae393668f45c6832933b601fb25d0 => generated 229 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:04.068331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7824e-1536-45bb-a2ef-d9cd53dd302f None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:04.186354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7824e-1536-45bb-a2ef-d9cd53dd302f None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:04.210748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:04.226533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c97c3-2a1b-4c8e-968b-a963c7305db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:04.227401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c97c3-2a1b-4c8e-968b-a963c7305db0 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:04.227709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c97c3-2a1b-4c8e-968b-a963c7305db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:04.227988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c97c3-2a1b-4c8e-968b-a963c7305db0 None admin] PATH_INFO: `/v3/projects/76cf5bbc77b94e4aad5326febc250cf3` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.229326 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c97c3-2a1b-4c8e-968b-a963c7305db0 None admin] RBAC: Authorizing `identity:get_project(project_id=76cf5bbc77b94e4aad5326febc250cf3)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:04.230780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c97c3-2a1b-4c8e-968b-a963c7305db0 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:04.232883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 214/414] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:04 2022] GET /identity/v3/projects/76cf5bbc77b94e4aad5326febc250cf3 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:04.238585 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bab1d8-df5d-499f-b851-774b95fd28bb None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:04.242098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:04.356854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bab1d8-df5d-499f-b851-774b95fd28bb None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:04.406020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed9290-95c3-476c-be2e-db71adb79524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:04.406948 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed9290-95c3-476c-be2e-db71adb79524 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:04.407235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed9290-95c3-476c-be2e-db71adb79524 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:04.407515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed9290-95c3-476c-be2e-db71adb79524 None admin] PATH_INFO: `/v3/projects/76cf5bbc77b94e4aad5326febc250cf3/groups/a61ae393668f45c6832933b601fb25d0/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.412566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed9290-95c3-476c-be2e-db71adb79524 None admin] RBAC: Authorizing `identity:create_grant(project_id=76cf5bbc77b94e4aad5326febc250cf3, group_id=a61ae393668f45c6832933b601fb25d0, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:04.414147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed9290-95c3-476c-be2e-db71adb79524 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:04.503690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 201/415] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jun 2 09:54:04 2022] PUT /identity/v3/projects/76cf5bbc77b94e4aad5326febc250cf3/groups/a61ae393668f45c6832933b601fb25d0/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:04.746168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8b55-62fb-466a-b0e9-2b9f56b84524 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:04.746168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8b55-62fb-466a-b0e9-2b9f56b84524 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:04.746168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8b55-62fb-466a-b0e9-2b9f56b84524 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.746909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 215/416] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:04.752574 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a8853-1124-43da-8c99-ccb266931c25 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:04.753018 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a8853-1124-43da-8c99-ccb266931c25 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:04.753206 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a8853-1124-43da-8c99-ccb266931c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:04.771737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c81a8853-1124-43da-8c99-ccb266931c25 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:04.773421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c81a8853-1124-43da-8c99-ccb266931c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:04.840625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:04.851866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 202/417] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:04.877152 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e8b55-62fb-466a-b0e9-2b9f56b84524 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:05.005242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e8b55-62fb-466a-b0e9-2b9f56b84524 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:05.042750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8852cf-8cbb-48a6-9764-185b6f45020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:05.043570 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8852cf-8cbb-48a6-9764-185b6f45020c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:05.043891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8852cf-8cbb-48a6-9764-185b6f45020c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:05.044166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8852cf-8cbb-48a6-9764-185b6f45020c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:05.055358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8852cf-8cbb-48a6-9764-185b6f45020c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-ae8852cf-8cbb-48a6-9764-185b6f45020c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:05.063894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:05.064800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:05.065794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 216/418] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:05.073021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a8853-1124-43da-8c99-ccb266931c25 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:05.221065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a8853-1124-43da-8c99-ccb266931c25 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:05.258656 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815a53-efac-4dca-83bd-3ee36de432c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:05.259740 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815a53-efac-4dca-83bd-3ee36de432c1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:05.260231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815a53-efac-4dca-83bd-3ee36de432c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:05.260720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f815a53-efac-4dca-83bd-3ee36de432c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:05.261729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815a53-efac-4dca-83bd-3ee36de432c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:05.262303 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815a53-efac-4dca-83bd-3ee36de432c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:05.263970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f815a53-efac-4dca-83bd-3ee36de432c1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:05.268242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4baa-57f8-4de0-9f8c-c7022014614b None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:05.268701 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4baa-57f8-4de0-9f8c-c7022014614b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:05.268875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe4baa-57f8-4de0-9f8c-c7022014614b None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:05.270432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 217/419] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:05.277019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80faa08-574f-4e54-a3d8-9c7cf0e46e32 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:05.277019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80faa08-574f-4e54-a3d8-9c7cf0e46e32 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:05.277019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80faa08-574f-4e54-a3d8-9c7cf0e46e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:05.277776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 203/420] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:05.281105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815a53-efac-4dca-83bd-3ee36de432c1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:05.294778 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a80faa08-574f-4e54-a3d8-9c7cf0e46e32 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:05.295940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a80faa08-574f-4e54-a3d8-9c7cf0e46e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:05.341078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:05.380001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:05.382268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 218/421] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:05.390388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f815a53-efac-4dca-83bd-3ee36de432c1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:05.407989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80faa08-574f-4e54-a3d8-9c7cf0e46e32 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:05.428136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e9d13-7c38-47b1-a8d5-2c3853dfe3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:05.429850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9d13-7c38-47b1-a8d5-2c3853dfe3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:05.430368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9d13-7c38-47b1-a8d5-2c3853dfe3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:05.430860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9d13-7c38-47b1-a8d5-2c3853dfe3e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:05.504083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e9d13-7c38-47b1-a8d5-2c3853dfe3e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:05.505935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e9d13-7c38-47b1-a8d5-2c3853dfe3e4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:05.532325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80faa08-574f-4e54-a3d8-9c7cf0e46e32 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:05.563134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:05.572315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819833c-35e2-4a68-9bb2-4df1311f0c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:05.580183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819833c-35e2-4a68-9bb2-4df1311f0c7e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:05.580183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819833c-35e2-4a68-9bb2-4df1311f0c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:05.580183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819833c-35e2-4a68-9bb2-4df1311f0c7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:05.593193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819833c-35e2-4a68-9bb2-4df1311f0c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-6819833c-35e2-4a68-9bb2-4df1311f0c7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:05.602090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:05.603218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:05.604366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:05.607790 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 219/422] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:05.609378 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819833c-35e2-4a68-9bb2-4df1311f0c7e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:05.615965 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 204/423] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:54:05.621846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e9d13-7c38-47b1-a8d5-2c3853dfe3e4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:05.656752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:05.735950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e9d13-7c38-47b1-a8d5-2c3853dfe3e4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:05.744294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819833c-35e2-4a68-9bb2-4df1311f0c7e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:05.773173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbfb11-9364-4c6c-bfd7-e0a4487ebd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:05.774672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbfb11-9364-4c6c-bfd7-e0a4487ebd22 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:05.775154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbfb11-9364-4c6c-bfd7-e0a4487ebd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:05.775599 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbfb11-9364-4c6c-bfd7-e0a4487ebd22 None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:05.777294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbfb11-9364-4c6c-bfd7-e0a4487ebd22 None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:05.778904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbfb11-9364-4c6c-bfd7-e0a4487ebd22 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:05.781415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 205/424] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:05 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:05.786976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbfb11-9364-4c6c-bfd7-e0a4487ebd22 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:05.813580 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:05.827609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dae848-6da0-4f5d-b391-6097ee19c37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:05.827609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dae848-6da0-4f5d-b391-6097ee19c37c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:05.827609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dae848-6da0-4f5d-b391-6097ee19c37c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:05.827609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dae848-6da0-4f5d-b391-6097ee19c37c None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:05.828073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dae848-6da0-4f5d-b391-6097ee19c37c None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:05.828073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dae848-6da0-4f5d-b391-6097ee19c37c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:05.828073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dae848-6da0-4f5d-b391-6097ee19c37c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:05.833634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 220/425] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:05.839563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dae848-6da0-4f5d-b391-6097ee19c37c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:05.904783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbfb11-9364-4c6c-bfd7-e0a4487ebd22 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:05.940622 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a7c9d-8778-484d-843a-b6ac7be070de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:05.941725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7c9d-8778-484d-843a-b6ac7be070de None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:05.942185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7c9d-8778-484d-843a-b6ac7be070de None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:05.942609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7c9d-8778-484d-843a-b6ac7be070de None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:05.944512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a7c9d-8778-484d-843a-b6ac7be070de None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:05.946117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a7c9d-8778-484d-843a-b6ac7be070de None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:05.951682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 206/426] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:05 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:05.954108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a7c9d-8778-484d-843a-b6ac7be070de None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.056182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.071682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a7c9d-8778-484d-843a-b6ac7be070de None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.112612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.118232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dae848-6da0-4f5d-b391-6097ee19c37c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.137989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc410f9e-bec3-438d-94fc-b8f035156b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.138639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc410f9e-bec3-438d-94fc-b8f035156b8e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.138930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc410f9e-bec3-438d-94fc-b8f035156b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.139213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc410f9e-bec3-438d-94fc-b8f035156b8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.140093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc410f9e-bec3-438d-94fc-b8f035156b8e None admin] RBAC: Adding query filter params (group.id=282660734c8a4ffa97401cb5ee4864a4, role.id=d98e80f5e9c34378bf50e810e4b8a210, scope.project.id=18750bb94664432fadddf1a1dadc20f6) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:06.140412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc410f9e-bec3-438d-94fc-b8f035156b8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:06.141863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc410f9e-bec3-438d-94fc-b8f035156b8e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:06.152511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 207/427] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:05 2022] GET /identity/v3/role_assignments?group.id=282660734c8a4ffa97401cb5ee4864a4&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=d98e80f5e9c34378bf50e810e4b8a210 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:06.172812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e0c2f-53f3-4b3b-83da-6ff8f2b03755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.173489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e0c2f-53f3-4b3b-83da-6ff8f2b03755 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.173782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e0c2f-53f3-4b3b-83da-6ff8f2b03755 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.174060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e0c2f-53f3-4b3b-83da-6ff8f2b03755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.237464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68269f-4ae3-4d97-8ea6-4833a9d96117 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.237780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68269f-4ae3-4d97-8ea6-4833a9d96117 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.238038 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68269f-4ae3-4d97-8ea6-4833a9d96117 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.239764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 208/428] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:06.248966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c71be-1442-4e74-a268-bb46fec4dc81 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.249292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c71be-1442-4e74-a268-bb46fec4dc81 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.249538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c71be-1442-4e74-a268-bb46fec4dc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.277740 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d88c71be-1442-4e74-a268-bb46fec4dc81 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:06.278995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d88c71be-1442-4e74-a268-bb46fec4dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:06.308912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e0c2f-53f3-4b3b-83da-6ff8f2b03755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:06.310402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e0c2f-53f3-4b3b-83da-6ff8f2b03755 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:06.418824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 209/429] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:06.432740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 221/430] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:06.433734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.443631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c71be-1442-4e74-a268-bb46fec4dc81 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.446794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e0c2f-53f3-4b3b-83da-6ff8f2b03755 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.551266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.560014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e0c2f-53f3-4b3b-83da-6ff8f2b03755 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.572632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c71be-1442-4e74-a268-bb46fec4dc81 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.608556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8dccd-2f5d-40a6-95a2-c21a10a1565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.609745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8dccd-2f5d-40a6-95a2-c21a10a1565c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.610320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8dccd-2f5d-40a6-95a2-c21a10a1565c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.610794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8dccd-2f5d-40a6-95a2-c21a10a1565c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.621932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a814b23-3fe2-4728-a25f-92ce195911bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.622800 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814b23-3fe2-4728-a25f-92ce195911bb None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.623078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814b23-3fe2-4728-a25f-92ce195911bb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.623348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814b23-3fe2-4728-a25f-92ce195911bb None admin] PATH_INFO: `/v3/projects/18750bb94664432fadddf1a1dadc20f6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.625137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a814b23-3fe2-4728-a25f-92ce195911bb None admin] RBAC: Authorizing `identity:get_project(project_id=18750bb94664432fadddf1a1dadc20f6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:06.626092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a814b23-3fe2-4728-a25f-92ce195911bb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:06.628264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 210/431] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/projects/18750bb94664432fadddf1a1dadc20f6 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:06.629884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8dccd-2f5d-40a6-95a2-c21a10a1565c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:06.634582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a814b23-3fe2-4728-a25f-92ce195911bb None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-4fc8dccd-2f5d-40a6-95a2-c21a10a1565c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:06.638878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:06.639836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 09:54:06.640634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:06.643128 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 222/432] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:06.649511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8dccd-2f5d-40a6-95a2-c21a10a1565c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.716632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.760808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a814b23-3fe2-4728-a25f-92ce195911bb None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.767773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8dccd-2f5d-40a6-95a2-c21a10a1565c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.798427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b011a8-b026-4f82-8759-c810f6a74168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.800022 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b011a8-b026-4f82-8759-c810f6a74168 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.800513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b011a8-b026-4f82-8759-c810f6a74168 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.800993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b011a8-b026-4f82-8759-c810f6a74168 None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.802421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b011a8-b026-4f82-8759-c810f6a74168 None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:06.804812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b011a8-b026-4f82-8759-c810f6a74168 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:06.807355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 211/433] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:06.809691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c2714-7db1-4587-84aa-00b7271222e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.810653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c2714-7db1-4587-84aa-00b7271222e9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.811140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c2714-7db1-4587-84aa-00b7271222e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.811672 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c2714-7db1-4587-84aa-00b7271222e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.812711 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b011a8-b026-4f82-8759-c810f6a74168 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.814023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c2714-7db1-4587-84aa-00b7271222e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:06.814903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c2714-7db1-4587-84aa-00b7271222e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:06.816644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c2714-7db1-4587-84aa-00b7271222e9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:06.827338 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 223/434] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:06.832910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c2714-7db1-4587-84aa-00b7271222e9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:06.844547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:06.929820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b011a8-b026-4f82-8759-c810f6a74168 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.951511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c2714-7db1-4587-84aa-00b7271222e9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:06.964791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2412e7-def7-4929-941b-db45ed3f6a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:06.965450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2412e7-def7-4929-941b-db45ed3f6a8d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.965730 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2412e7-def7-4929-941b-db45ed3f6a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.966004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2412e7-def7-4929-941b-db45ed3f6a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.966884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2412e7-def7-4929-941b-db45ed3f6a8d None admin] RBAC: Adding query filter params (group.id=282660734c8a4ffa97401cb5ee4864a4, role.id=67cb3b4802a642ae98a93929ca7b724c, scope.project.id=18750bb94664432fadddf1a1dadc20f6) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:06.967142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2412e7-def7-4929-941b-db45ed3f6a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:06.968593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2412e7-def7-4929-941b-db45ed3f6a8d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:06.983678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 212/435] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/role_assignments?group.id=282660734c8a4ffa97401cb5ee4864a4&scope.project.id=18750bb94664432fadddf1a1dadc20f6&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:06.983678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a978f-25fe-4ed0-b571-3cd662b466fd None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.983678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a978f-25fe-4ed0-b571-3cd662b466fd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.983678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a978f-25fe-4ed0-b571-3cd662b466fd None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.983678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 213/436] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:06.984185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4e7fc-d584-422b-b60e-9e6dcbf9fc1b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:06.984185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4e7fc-d584-422b-b60e-9e6dcbf9fc1b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:06.984330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4e7fc-d584-422b-b60e-9e6dcbf9fc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:06.985271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:07.002996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d62441-876d-4286-b49d-88e7d4036316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.003881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d62441-876d-4286-b49d-88e7d4036316 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.004244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d62441-876d-4286-b49d-88e7d4036316 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.004601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d62441-876d-4286-b49d-88e7d4036316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.007002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d8c4e7fc-d584-422b-b60e-9e6dcbf9fc1b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:07.008303 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d8c4e7fc-d584-422b-b60e-9e6dcbf9fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:07.094648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 214/437] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:07.110643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d62441-876d-4286-b49d-88e7d4036316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:07.112313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d62441-876d-4286-b49d-88e7d4036316 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:07.120899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4e7fc-d584-422b-b60e-9e6dcbf9fc1b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:07.140104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:07.235457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 224/438] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 09:54:07.243929 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d62441-876d-4286-b49d-88e7d4036316 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:07.256218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4e7fc-d584-422b-b60e-9e6dcbf9fc1b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:07.273435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:07.296971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6a0cf-ef59-4d56-b845-961ed49a1df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.297851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6a0cf-ef59-4d56-b845-961ed49a1df3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.298676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6a0cf-ef59-4d56-b845-961ed49a1df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.298984 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6a0cf-ef59-4d56-b845-961ed49a1df3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.316586 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6a0cf-ef59-4d56-b845-961ed49a1df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-23a6a0cf-ef59-4d56-b845-961ed49a1df3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:07.327343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:07.328441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:07.329261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 215/439] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:07.334719 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6a0cf-ef59-4d56-b845-961ed49a1df3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:07.384253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d62441-876d-4286-b49d-88e7d4036316 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:07.427179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178dca3-8dca-4ffa-8ec6-1b1c69eeda0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.429343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178dca3-8dca-4ffa-8ec6-1b1c69eeda0e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.429820 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178dca3-8dca-4ffa-8ec6-1b1c69eeda0e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.430401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178dca3-8dca-4ffa-8ec6-1b1c69eeda0e None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.431883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178dca3-8dca-4ffa-8ec6-1b1c69eeda0e None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:07.434183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178dca3-8dca-4ffa-8ec6-1b1c69eeda0e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:07.436244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 225/440] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:07 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:07.437734 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:07.440563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87a482-e3e6-406a-841b-689914ac3f38 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.441279 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87a482-e3e6-406a-841b-689914ac3f38 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.441742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87a482-e3e6-406a-841b-689914ac3f38 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.443306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 226/441] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:07.444163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87a482-e3e6-406a-841b-689914ac3f38 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:07.477465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6a0cf-ef59-4d56-b845-961ed49a1df3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:07.513524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c1900-10b6-4cc2-8738-8959e520de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.514249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c1900-10b6-4cc2-8738-8959e520de58 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.514594 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c1900-10b6-4cc2-8738-8959e520de58 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.514882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c1900-10b6-4cc2-8738-8959e520de58 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.515705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c1900-10b6-4cc2-8738-8959e520de58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:07.516080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c1900-10b6-4cc2-8738-8959e520de58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:07.517515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c1900-10b6-4cc2-8738-8959e520de58 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:07.531288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 216/442] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:07.531288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde784-fb9e-4a4e-a0be-5b826b7d1a0d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.531288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde784-fb9e-4a4e-a0be-5b826b7d1a0d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.531288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bde784-fb9e-4a4e-a0be-5b826b7d1a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.549507 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-01bde784-fb9e-4a4e-a0be-5b826b7d1a0d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:07.550810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-01bde784-fb9e-4a4e-a0be-5b826b7d1a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:07.562063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:07.574261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87a482-e3e6-406a-841b-689914ac3f38 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:07.620721 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e16a9-b7d6-47d0-a83f-c52704b8ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.621810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e16a9-b7d6-47d0-a83f-c52704b8ae9c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.622237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e16a9-b7d6-47d0-a83f-c52704b8ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.622655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e16a9-b7d6-47d0-a83f-c52704b8ae9c None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.624054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e16a9-b7d6-47d0-a83f-c52704b8ae9c None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:07.625506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e16a9-b7d6-47d0-a83f-c52704b8ae9c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:07.627111 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 227/443] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:07 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:07.628042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e16a9-b7d6-47d0-a83f-c52704b8ae9c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:07.633087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 217/444] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:07.636633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bde784-fb9e-4a4e-a0be-5b826b7d1a0d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:07.708655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:07.739051 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e16a9-b7d6-47d0-a83f-c52704b8ae9c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:07.741765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bde784-fb9e-4a4e-a0be-5b826b7d1a0d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:07.773048 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1940f1-ecda-4d98-8392-db85217af97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.773601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1940f1-ecda-4d98-8392-db85217af97b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.773886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1940f1-ecda-4d98-8392-db85217af97b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.774162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1940f1-ecda-4d98-8392-db85217af97b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.775383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6e37b-deaa-4587-aa8d-28182de2ff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.776067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6e37b-deaa-4587-aa8d-28182de2ff21 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.776600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6e37b-deaa-4587-aa8d-28182de2ff21 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.776877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6e37b-deaa-4587-aa8d-28182de2ff21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.777696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6e37b-deaa-4587-aa8d-28182de2ff21 None admin] RBAC: Adding query filter params (group.id=282660734c8a4ffa97401cb5ee4864a4, role.id=67cb3b4802a642ae98a93929ca7b724c, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:07.778007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6e37b-deaa-4587-aa8d-28182de2ff21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:07.779453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6e37b-deaa-4587-aa8d-28182de2ff21 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:07.785208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 218/445] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:07 2022] GET /identity/v3/role_assignments?group.id=282660734c8a4ffa97401cb5ee4864a4&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=67cb3b4802a642ae98a93929ca7b724c => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:07.785977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6e37b-deaa-4587-aa8d-28182de2ff21 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:07.804600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:07.854146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1940f1-ecda-4d98-8392-db85217af97b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:07.855882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1940f1-ecda-4d98-8392-db85217af97b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:07.911684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6e37b-deaa-4587-aa8d-28182de2ff21 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:07.944718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:07.951854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb62fd-8a52-4d5c-92a8-512b06767cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:07.952717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb62fd-8a52-4d5c-92a8-512b06767cbd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:07.952995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb62fd-8a52-4d5c-92a8-512b06767cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:07.953318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb62fd-8a52-4d5c-92a8-512b06767cbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:07.966152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb62fd-8a52-4d5c-92a8-512b06767cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-79bb62fd-8a52-4d5c-92a8-512b06767cbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:07.974544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:07.975672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:07.976489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:07.977180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 228/446] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:07.977251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 219/447] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:07.982007 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1940f1-ecda-4d98-8392-db85217af97b None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:07.982837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb62fd-8a52-4d5c-92a8-512b06767cbd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:08.058331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:08.105916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1940f1-ecda-4d98-8392-db85217af97b None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:08.108935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb62fd-8a52-4d5c-92a8-512b06767cbd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:08.150763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced88779-01e3-4ec4-9588-bc740c215d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:08.152028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced88779-01e3-4ec4-9588-bc740c215d21 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:08.152380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced88779-01e3-4ec4-9588-bc740c215d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:08.152717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced88779-01e3-4ec4-9588-bc740c215d21 None admin] PATH_INFO: `/v3/projects/0bd52514ff434e4eaa4b9885515ae22c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:08.153954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced88779-01e3-4ec4-9588-bc740c215d21 None admin] RBAC: Authorizing `identity:get_project(project_id=0bd52514ff434e4eaa4b9885515ae22c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:08.154895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14ce02-1105-4616-aee5-28f0916837f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:08.155613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced88779-01e3-4ec4-9588-bc740c215d21 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:08.155726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14ce02-1105-4616-aee5-28f0916837f9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:08.155894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14ce02-1105-4616-aee5-28f0916837f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:08.156140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14ce02-1105-4616-aee5-28f0916837f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:08.156900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14ce02-1105-4616-aee5-28f0916837f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:08.157345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 220/448] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:07 2022] GET /identity/v3/projects/0bd52514ff434e4eaa4b9885515ae22c => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:08.157450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14ce02-1105-4616-aee5-28f0916837f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:08.158628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14ce02-1105-4616-aee5-28f0916837f9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:08.162845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced88779-01e3-4ec4-9588-bc740c215d21 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:08.170267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 229/449] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:08.176376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14ce02-1105-4616-aee5-28f0916837f9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:08.229019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:08.270979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced88779-01e3-4ec4-9588-bc740c215d21 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:08.281105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14ce02-1105-4616-aee5-28f0916837f9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:08.301199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:08.305500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654b4ea-0c1b-4005-94be-322026e51270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:08.306353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654b4ea-0c1b-4005-94be-322026e51270 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:08.306631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654b4ea-0c1b-4005-94be-322026e51270 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:08.306904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654b4ea-0c1b-4005-94be-322026e51270 None admin] PATH_INFO: `/v3/groups/282660734c8a4ffa97401cb5ee4864a4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:08.308098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654b4ea-0c1b-4005-94be-322026e51270 None admin] RBAC: Authorizing `identity:get_group(group_id=282660734c8a4ffa97401cb5ee4864a4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:08.314960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654b4ea-0c1b-4005-94be-322026e51270 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:08.314960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 221/450] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:08 2022] GET /identity/v3/groups/282660734c8a4ffa97401cb5ee4864a4 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:08.315211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19151886-0804-492d-8cb8-055d95599161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:08.315988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19151886-0804-492d-8cb8-055d95599161 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:08.316286 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19151886-0804-492d-8cb8-055d95599161 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:08.316569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19151886-0804-492d-8cb8-055d95599161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:08.316938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654b4ea-0c1b-4005-94be-322026e51270 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:08.386809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19151886-0804-492d-8cb8-055d95599161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:08.388309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19151886-0804-492d-8cb8-055d95599161 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:08.419674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654b4ea-0c1b-4005-94be-322026e51270 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:08.445654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:08.454079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aa4a1-6c7c-4ae8-9695-5d369fc13584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:08.454741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aa4a1-6c7c-4ae8-9695-5d369fc13584 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:08.455029 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aa4a1-6c7c-4ae8-9695-5d369fc13584 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:08.455310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aa4a1-6c7c-4ae8-9695-5d369fc13584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:08.456184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aa4a1-6c7c-4ae8-9695-5d369fc13584 None admin] RBAC: Adding query filter params (group.id=282660734c8a4ffa97401cb5ee4864a4, role.id=d98e80f5e9c34378bf50e810e4b8a210, scope.project.id=0bd52514ff434e4eaa4b9885515ae22c) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:08.456500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aa4a1-6c7c-4ae8-9695-5d369fc13584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:08.458001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aa4a1-6c7c-4ae8-9695-5d369fc13584 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:08.464354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 222/451] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:08 2022] GET /identity/v3/role_assignments?group.id=282660734c8a4ffa97401cb5ee4864a4&scope.project.id=0bd52514ff434e4eaa4b9885515ae22c&role.id=d98e80f5e9c34378bf50e810e4b8a210 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:08.488298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 230/452] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:08.494145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aa4a1-6c7c-4ae8-9695-5d369fc13584 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:08.722062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aa4a1-6c7c-4ae8-9695-5d369fc13584 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:08.755837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d58186-a5cf-4c02-adf3-05e8bbb2a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:08.757229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d58186-a5cf-4c02-adf3-05e8bbb2a470 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:08.757503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d58186-a5cf-4c02-adf3-05e8bbb2a470 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:08.757772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d58186-a5cf-4c02-adf3-05e8bbb2a470 None admin] PATH_INFO: `/v3/projects/76cf5bbc77b94e4aad5326febc250cf3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:08.758959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d58186-a5cf-4c02-adf3-05e8bbb2a470 None admin] RBAC: Authorizing `identity:get_project(project_id=76cf5bbc77b94e4aad5326febc250cf3)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:08.760422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d58186-a5cf-4c02-adf3-05e8bbb2a470 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:08.762093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 223/453] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:54:08 2022] GET /identity/v3/projects/76cf5bbc77b94e4aad5326febc250cf3 => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:08.767624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19151886-0804-492d-8cb8-055d95599161 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:08.790737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:08.869982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19151886-0804-492d-8cb8-055d95599161 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:08.904373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48db2a-488a-4ae8-86f2-848bd380c2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:08.905212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48db2a-488a-4ae8-86f2-848bd380c2bd None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:08.905491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48db2a-488a-4ae8-86f2-848bd380c2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:08.905762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48db2a-488a-4ae8-86f2-848bd380c2bd None admin] PATH_INFO: `/v3/groups/a61ae393668f45c6832933b601fb25d0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:08.906901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48db2a-488a-4ae8-86f2-848bd380c2bd None admin] RBAC: Authorizing `identity:get_group(group_id=a61ae393668f45c6832933b601fb25d0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:08.908371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48db2a-488a-4ae8-86f2-848bd380c2bd None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:08.909966 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 231/454] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jun 2 09:54:08 2022] GET /identity/v3/groups/a61ae393668f45c6832933b601fb25d0 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:08.916002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d58186-a5cf-4c02-adf3-05e8bbb2a470 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:08.972573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:09.012860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d58186-a5cf-4c02-adf3-05e8bbb2a470 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:09.045301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3464cb6-3680-43e2-9dda-97ec0cde84c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:09.046849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3464cb6-3680-43e2-9dda-97ec0cde84c5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:09.046849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3464cb6-3680-43e2-9dda-97ec0cde84c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:09.046849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3464cb6-3680-43e2-9dda-97ec0cde84c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:09.047322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3464cb6-3680-43e2-9dda-97ec0cde84c5 None admin] RBAC: Adding query filter params (group.id=a61ae393668f45c6832933b601fb25d0, role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=76cf5bbc77b94e4aad5326febc250cf3) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:09.047669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3464cb6-3680-43e2-9dda-97ec0cde84c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:09.049111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3464cb6-3680-43e2-9dda-97ec0cde84c5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:09.055324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 224/455] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jun 2 09:54:08 2022] GET /identity/v3/role_assignments?group.id=a61ae393668f45c6832933b601fb25d0&scope.project.id=76cf5bbc77b94e4aad5326febc250cf3&role.id=918b179f19b6437493eabe5394fa9af0 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:11.661560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a6ff-b70f-488c-bdef-039d921c40d3 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.663127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a6ff-b70f-488c-bdef-039d921c40d3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.663645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810a6ff-b70f-488c-bdef-039d921c40d3 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.665436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 232/456] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:11.671195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2bdac-9c05-46bd-90a7-3ff0d70892e1 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.672083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2bdac-9c05-46bd-90a7-3ff0d70892e1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.672592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2bdac-9c05-46bd-90a7-3ff0d70892e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.700644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-25a2bdac-9c05-46bd-90a7-3ff0d70892e1 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:11.702182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-25a2bdac-9c05-46bd-90a7-3ff0d70892e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:11.800286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 225/457] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:11.837148 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810a6ff-b70f-488c-bdef-039d921c40d3 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:11.905001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be607-dffd-43f0-8f79-de839a2e15a8 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.905639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be607-dffd-43f0-8f79-de839a2e15a8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.906119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5be607-dffd-43f0-8f79-de839a2e15a8 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.907716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 226/458] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:11.916298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a7d3d-88fb-47b3-b5b8-2ff56e2e5302 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:11.916519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a7d3d-88fb-47b3-b5b8-2ff56e2e5302 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:11.916974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a7d3d-88fb-47b3-b5b8-2ff56e2e5302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:11.956630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-527a7d3d-88fb-47b3-b5b8-2ff56e2e5302 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:11.958074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-527a7d3d-88fb-47b3-b5b8-2ff56e2e5302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:11.967311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:11.983224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810a6ff-b70f-488c-bdef-039d921c40d3 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.043284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24be3f0-58a8-456b-ba98-940f4190e54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.044116 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24be3f0-58a8-456b-ba98-940f4190e54b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.044400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24be3f0-58a8-456b-ba98-940f4190e54b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.044679 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24be3f0-58a8-456b-ba98-940f4190e54b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.059957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:12.069832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24be3f0-58a8-456b-ba98-940f4190e54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.071312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24be3f0-58a8-456b-ba98-940f4190e54b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.088940 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 227/459] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-e24be3f0-58a8-456b-ba98-940f4190e54b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:12.106564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:12.107523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:12.108419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:12.108419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:12.108419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:12.108419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:12.108419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 233/460] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:12.113706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a7d3d-88fb-47b3-b5b8-2ff56e2e5302 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.128654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24be3f0-58a8-456b-ba98-940f4190e54b None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.296552 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24be3f0-58a8-456b-ba98-940f4190e54b None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.298645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a7d3d-88fb-47b3-b5b8-2ff56e2e5302 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.353015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf06a14-7038-4709-8958-e2e007cb57b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.354218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf06a14-7038-4709-8958-e2e007cb57b2 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.354653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf06a14-7038-4709-8958-e2e007cb57b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.355203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf06a14-7038-4709-8958-e2e007cb57b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.355712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f338c42-6fea-4caf-8f23-c7f59f2c68bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.356392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f338c42-6fea-4caf-8f23-c7f59f2c68bb None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.356676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f338c42-6fea-4caf-8f23-c7f59f2c68bb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.356953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f338c42-6fea-4caf-8f23-c7f59f2c68bb None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.357686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f338c42-6fea-4caf-8f23-c7f59f2c68bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:12.358023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f338c42-6fea-4caf-8f23-c7f59f2c68bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.359371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f338c42-6fea-4caf-8f23-c7f59f2c68bb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.367921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf06a14-7038-4709-8958-e2e007cb57b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.369750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf06a14-7038-4709-8958-e2e007cb57b2 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.389867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 228/461] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:12.390260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-ddf06a14-7038-4709-8958-e2e007cb57b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:12.392011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:12.395143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:12.396171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:12.396171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:12.396171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:12.396171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:12.396171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 234/462] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:12.397150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f338c42-6fea-4caf-8f23-c7f59f2c68bb None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.404941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf06a14-7038-4709-8958-e2e007cb57b2 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.473142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:12.565115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf06a14-7038-4709-8958-e2e007cb57b2 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.570634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f338c42-6fea-4caf-8f23-c7f59f2c68bb None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.600879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82d139-7e84-4b29-8904-88a4248f4b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.601763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82d139-7e84-4b29-8904-88a4248f4b5c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.602201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82d139-7e84-4b29-8904-88a4248f4b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.602481 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82d139-7e84-4b29-8904-88a4248f4b5c None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.603198 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82d139-7e84-4b29-8904-88a4248f4b5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:12.603505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82d139-7e84-4b29-8904-88a4248f4b5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.604897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82d139-7e84-4b29-8904-88a4248f4b5c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.606713 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339b052-2811-4336-b639-7bc752ca5d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.607462 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339b052-2811-4336-b639-7bc752ca5d3f None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.607779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339b052-2811-4336-b639-7bc752ca5d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.608060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339b052-2811-4336-b639-7bc752ca5d3f None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.608783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339b052-2811-4336-b639-7bc752ca5d3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.610264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339b052-2811-4336-b639-7bc752ca5d3f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.617785 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 235/463] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:12.618875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb365f-c82e-4202-8bc5-42cd9dd4416b None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.619162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb365f-c82e-4202-8bc5-42cd9dd4416b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.619443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb365f-c82e-4202-8bc5-42cd9dd4416b None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.620681 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 236/464] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:12.621726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab74e-a4b6-4e16-a5c9-b1acb2dd9d3d None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.623427 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab74e-a4b6-4e16-a5c9-b1acb2dd9d3d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.624683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdab74e-a4b6-4e16-a5c9-b1acb2dd9d3d None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.626099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 237/465] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:12.626795 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdab74e-a4b6-4e16-a5c9-b1acb2dd9d3d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.682656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:12.705284 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 229/466] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:12 2022] POST /identity/v3/users => generated 246 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:54:12.706608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428e0b-f7b2-4de4-b787-88e27c6bcbeb None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.706956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428e0b-f7b2-4de4-b787-88e27c6bcbeb None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.707248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428e0b-f7b2-4de4-b787-88e27c6bcbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.730009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-39428e0b-f7b2-4de4-b787-88e27c6bcbeb None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:12.731483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-39428e0b-f7b2-4de4-b787-88e27c6bcbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:12.751824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdab74e-a4b6-4e16-a5c9-b1acb2dd9d3d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:12.805211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957fcef-fdfc-4086-b2c3-ede3516f1204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:12.806599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957fcef-fdfc-4086-b2c3-ede3516f1204 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.807531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957fcef-fdfc-4086-b2c3-ede3516f1204 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.808093 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957fcef-fdfc-4086-b2c3-ede3516f1204 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.809039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957fcef-fdfc-4086-b2c3-ede3516f1204 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:12.811513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957fcef-fdfc-4086-b2c3-ede3516f1204 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:12.835510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 230/467] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:12.835510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf18dfc-31f3-480a-9c34-ff4826bfa84e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:12.835510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf18dfc-31f3-480a-9c34-ff4826bfa84e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:12.835510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf18dfc-31f3-480a-9c34-ff4826bfa84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:12.859212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ecf18dfc-31f3-480a-9c34-ff4826bfa84e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:12.860831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ecf18dfc-31f3-480a-9c34-ff4826bfa84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:12.892768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:12.905004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 238/468] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:12 2022] POST /identity/v3/users => generated 248 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:12.906499 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957fcef-fdfc-4086-b2c3-ede3516f1204 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:12.945249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 231/469] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:12.975155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf18dfc-31f3-480a-9c34-ff4826bfa84e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.044091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957fcef-fdfc-4086-b2c3-ede3516f1204 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.057294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.089232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66228-0223-4304-a14b-d5dab7b77074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.090911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66228-0223-4304-a14b-d5dab7b77074 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.091660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66228-0223-4304-a14b-d5dab7b77074 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.092140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a66228-0223-4304-a14b-d5dab7b77074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.108091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a66228-0223-4304-a14b-d5dab7b77074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.110426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a66228-0223-4304-a14b-d5dab7b77074 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.114378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf18dfc-31f3-480a-9c34-ff4826bfa84e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-57a66228-0223-4304-a14b-d5dab7b77074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:13.134999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:13.135967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:13.136811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:13.136811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:13.136811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:13.136811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:13.137034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 239/470] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:13.146569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66228-0223-4304-a14b-d5dab7b77074 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.165000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaaf09-71ea-4c28-b1f8-4f2084d05063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.165811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaaf09-71ea-4c28-b1f8-4f2084d05063 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.166091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaaf09-71ea-4c28-b1f8-4f2084d05063 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.166370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaaf09-71ea-4c28-b1f8-4f2084d05063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.178907 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eaaf09-71ea-4c28-b1f8-4f2084d05063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.180433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eaaf09-71ea-4c28-b1f8-4f2084d05063 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-39eaaf09-71ea-4c28-b1f8-4f2084d05063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:13.203286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:13.204276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:13.205123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:13.205123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:13.205123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:13.205123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:13.206831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 232/471] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:13.212170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaaf09-71ea-4c28-b1f8-4f2084d05063 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.228793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.290198 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a66228-0223-4304-a14b-d5dab7b77074 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.341810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e58a5-1a16-4b66-a064-318896a4095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.342644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e58a5-1a16-4b66-a064-318896a4095d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.342928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e58a5-1a16-4b66-a064-318896a4095d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.343626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e58a5-1a16-4b66-a064-318896a4095d None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.344641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e58a5-1a16-4b66-a064-318896a4095d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:13.344954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e58a5-1a16-4b66-a064-318896a4095d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.346024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaaf09-71ea-4c28-b1f8-4f2084d05063 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.346332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e58a5-1a16-4b66-a064-318896a4095d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.368159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 240/472] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:13.369997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e58a5-1a16-4b66-a064-318896a4095d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.393385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946222ce-3eaa-468d-8ffc-ef0ff261bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.394187 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946222ce-3eaa-468d-8ffc-ef0ff261bb56 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.394480 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946222ce-3eaa-468d-8ffc-ef0ff261bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.394761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946222ce-3eaa-468d-8ffc-ef0ff261bb56 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.395500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946222ce-3eaa-468d-8ffc-ef0ff261bb56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:13.395841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946222ce-3eaa-468d-8ffc-ef0ff261bb56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.397545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.399720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946222ce-3eaa-468d-8ffc-ef0ff261bb56 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.413313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 233/473] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:13.419171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70344-f372-4e4a-b19e-56c8673b157b None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.419492 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70344-f372-4e4a-b19e-56c8673b157b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.419808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f70344-f372-4e4a-b19e-56c8673b157b None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.421366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 234/474] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:13.421905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f70344-f372-4e4a-b19e-56c8673b157b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.486831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e58a5-1a16-4b66-a064-318896a4095d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.510420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.524138 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bce83a-2608-4b9a-8335-94a3ee5a9ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.525164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bce83a-2608-4b9a-8335-94a3ee5a9ee4 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.525463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bce83a-2608-4b9a-8335-94a3ee5a9ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.525742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bce83a-2608-4b9a-8335-94a3ee5a9ee4 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.526828 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bce83a-2608-4b9a-8335-94a3ee5a9ee4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.528325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bce83a-2608-4b9a-8335-94a3ee5a9ee4 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.548395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f70344-f372-4e4a-b19e-56c8673b157b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.585912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff978d-3d71-4406-8d0d-e8f93a7f8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.586586 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff978d-3d71-4406-8d0d-e8f93a7f8624 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.586865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff978d-3d71-4406-8d0d-e8f93a7f8624 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.587136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff978d-3d71-4406-8d0d-e8f93a7f8624 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.587869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff978d-3d71-4406-8d0d-e8f93a7f8624 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.589318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff978d-3d71-4406-8d0d-e8f93a7f8624 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:13.629503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 241/475] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:13 2022] POST /identity/v3/users => generated 249 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:54:13.631164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db229c70-269e-4953-ace2-709dca9d4513 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.631681 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db229c70-269e-4953-ace2-709dca9d4513 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.632181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db229c70-269e-4953-ace2-709dca9d4513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.651539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-db229c70-269e-4953-ace2-709dca9d4513 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:13.653262 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-db229c70-269e-4953-ace2-709dca9d4513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:13.706853 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 235/476] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:13 2022] POST /identity/v3/users => generated 248 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:13.745158 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 242/477] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:13.784566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff978d-3d71-4406-8d0d-e8f93a7f8624 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:13.942471 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff978d-3d71-4406-8d0d-e8f93a7f8624 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:13.982343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:13.996355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cccd75-400b-49d4-92b3-016ef3f3f438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:13.997072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccd75-400b-49d4-92b3-016ef3f3f438 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:13.997361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccd75-400b-49d4-92b3-016ef3f3f438 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:13.997640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cccd75-400b-49d4-92b3-016ef3f3f438 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:13.999530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cccd75-400b-49d4-92b3-016ef3f3f438 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:13.999854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cccd75-400b-49d4-92b3-016ef3f3f438 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:14.057441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.sql.core [None req-00cccd75-400b-49d4-92b3-016ef3f3f438 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 09:54:14.057441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 09:54:14.057441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [parameters: {'id': '02bbdf326bc74e27ab4ced4887cb1da8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 09:54:14.057441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80299) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-00cccd75-400b-49d4-92b3-016ef3f3f438 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result.read() Jun 02 09:54:14.075070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:54:14.076072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application yield resource Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise self.value Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application session.commit() Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 09:54:14.077063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.session.flush() Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application compat.raise_( Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 09:54:14.077942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:54:14.078833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result.read() Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:54:14.080718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [parameters: {'id': '02bbdf326bc74e27ab4ced4887cb1da8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:14.082629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 09:54:14.085002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:14.086956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 236/478] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jun 2 09:54:13 2022] POST /identity/v3/roles => generated 144 bytes in 293 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:14.087099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db229c70-269e-4953-ace2-709dca9d4513 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:14.093248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:14.204849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db229c70-269e-4953-ace2-709dca9d4513 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:14.242809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e075f9-5dcd-4613-bfa8-52dbec542197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:14.244044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e075f9-5dcd-4613-bfa8-52dbec542197 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:14.244552 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e075f9-5dcd-4613-bfa8-52dbec542197 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:14.245019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e075f9-5dcd-4613-bfa8-52dbec542197 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:14.256305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e075f9-5dcd-4613-bfa8-52dbec542197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-b9e075f9-5dcd-4613-bfa8-52dbec542197 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:14.264611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:14.265549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 09:54:14.266337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:14.269038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 243/479] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:14.274867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cccd75-400b-49d4-92b3-016ef3f3f438 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:14.383070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cccd75-400b-49d4-92b3-016ef3f3f438 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:14.423013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7b2ff-7e32-487b-a7d6-a0f296ab55c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:14.424062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7b2ff-7e32-487b-a7d6-a0f296ab55c2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:14.424595 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7b2ff-7e32-487b-a7d6-a0f296ab55c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:14.425220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7b2ff-7e32-487b-a7d6-a0f296ab55c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:14.426185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7b2ff-7e32-487b-a7d6-a0f296ab55c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:14.426700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7b2ff-7e32-487b-a7d6-a0f296ab55c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:14.428892 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7b2ff-7e32-487b-a7d6-a0f296ab55c2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:14.446169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 237/480] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:15.572646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14adc2e-f8f6-4ede-bdcb-3d9b7fcb6f8d None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:15.573167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14adc2e-f8f6-4ede-bdcb-3d9b7fcb6f8d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:15.573471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14adc2e-f8f6-4ede-bdcb-3d9b7fcb6f8d None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:15.575046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 244/481] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:15.580422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1484e-a883-4a87-8ca0-f580f2ba4df7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:15.580820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1484e-a883-4a87-8ca0-f580f2ba4df7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:15.581154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1484e-a883-4a87-8ca0-f580f2ba4df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:15.602915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-41d1484e-a883-4a87-8ca0-f580f2ba4df7 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:15.604119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-41d1484e-a883-4a87-8ca0-f580f2ba4df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:15.675600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:15.701235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 238/482] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:15.753495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14adc2e-f8f6-4ede-bdcb-3d9b7fcb6f8d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:15.812819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df8ff3-199d-4ec3-a462-b5994d8fc77b None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:15.813134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df8ff3-199d-4ec3-a462-b5994d8fc77b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:15.813393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df8ff3-199d-4ec3-a462-b5994d8fc77b None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:15.815059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 239/483] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:15.820671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a42a22-eb3a-4c89-94b7-9e769013314f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:15.822593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a42a22-eb3a-4c89-94b7-9e769013314f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:15.822593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a42a22-eb3a-4c89-94b7-9e769013314f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:15.845789 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b7a42a22-eb3a-4c89-94b7-9e769013314f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:15.846913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b7a42a22-eb3a-4c89-94b7-9e769013314f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:15.871918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:15.935993 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14adc2e-f8f6-4ede-bdcb-3d9b7fcb6f8d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:15.981031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 240/484] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:16.000288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc34aa2-3f6b-4ecd-a8de-1174f84262c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.001112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc34aa2-3f6b-4ecd-a8de-1174f84262c2 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.001399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc34aa2-3f6b-4ecd-a8de-1174f84262c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.001680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc34aa2-3f6b-4ecd-a8de-1174f84262c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.016369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a42a22-eb3a-4c89-94b7-9e769013314f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.020091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc34aa2-3f6b-4ecd-a8de-1174f84262c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-bdc34aa2-3f6b-4ecd-a8de-1174f84262c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:16.028999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:16.029930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:16.030750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:16.034979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 245/485] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:16.036284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc34aa2-3f6b-4ecd-a8de-1174f84262c2 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.168526 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a42a22-eb3a-4c89-94b7-9e769013314f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.183622 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:16.205965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc34aa2-3f6b-4ecd-a8de-1174f84262c2 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.207956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd2d40-7d65-4185-ac33-b863459fb8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.209599 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd2d40-7d65-4185-ac33-b863459fb8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.210489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd2d40-7d65-4185-ac33-b863459fb8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.211048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd2d40-7d65-4185-ac33-b863459fb8f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.224111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd2d40-7d65-4185-ac33-b863459fb8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-44fd2d40-7d65-4185-ac33-b863459fb8f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:16.233914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:16.234911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:16.235749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:16.238774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 241/486] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:16.245246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd2d40-7d65-4185-ac33-b863459fb8f2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.271637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:16.286565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb6535-41e2-45bb-9742-a2951e28bfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.287864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb6535-41e2-45bb-9742-a2951e28bfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.288153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb6535-41e2-45bb-9742-a2951e28bfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.288437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb6535-41e2-45bb-9742-a2951e28bfa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.289198 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb6535-41e2-45bb-9742-a2951e28bfa1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:16.289509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb6535-41e2-45bb-9742-a2951e28bfa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:16.292154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb6535-41e2-45bb-9742-a2951e28bfa1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:16.315369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 246/487] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:16.318597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb6535-41e2-45bb-9742-a2951e28bfa1 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.433957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd2d40-7d65-4185-ac33-b863459fb8f2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.499941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb6535-41e2-45bb-9742-a2951e28bfa1 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.506243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ec1d-ce93-4edc-a2e2-f381df889af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.507409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ec1d-ce93-4edc-a2e2-f381df889af5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.512318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ec1d-ce93-4edc-a2e2-f381df889af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.512827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ec1d-ce93-4edc-a2e2-f381df889af5 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.513816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138ec1d-ce93-4edc-a2e2-f381df889af5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:16.514353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138ec1d-ce93-4edc-a2e2-f381df889af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:16.515979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138ec1d-ce93-4edc-a2e2-f381df889af5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:16.526802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 242/488] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:16.539800 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ec1d-ce93-4edc-a2e2-f381df889af5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.553806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de743888-b8d1-4a67-8597-9fd04f964fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.554578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743888-b8d1-4a67-8597-9fd04f964fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.554872 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743888-b8d1-4a67-8597-9fd04f964fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.555144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743888-b8d1-4a67-8597-9fd04f964fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.566251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de743888-b8d1-4a67-8597-9fd04f964fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:16.567893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de743888-b8d1-4a67-8597-9fd04f964fa3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-de743888-b8d1-4a67-8597-9fd04f964fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:16.586261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:16.587596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:16.588477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:16.588477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:16.588477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:16.588477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:16.588477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 247/489] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:16.593102 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2628-f13e-4d12-820d-7a3b738fa9c2 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.593392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2628-f13e-4d12-820d-7a3b738fa9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.593669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a2628-f13e-4d12-820d-7a3b738fa9c2 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.595630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 248/490] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:16.596438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2628-f13e-4d12-820d-7a3b738fa9c2 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.600300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:16.644891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:16.663401 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ec1d-ce93-4edc-a2e2-f381df889af5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.703471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a2628-f13e-4d12-820d-7a3b738fa9c2 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.708171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f7d39-4d52-4db5-ba8f-ea2240087a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.709816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7d39-4d52-4db5-ba8f-ea2240087a52 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.710449 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7d39-4d52-4db5-ba8f-ea2240087a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.710885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7d39-4d52-4db5-ba8f-ea2240087a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.723232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f7d39-4d52-4db5-ba8f-ea2240087a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:16.725457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f7d39-4d52-4db5-ba8f-ea2240087a52 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:16.739482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00adf6e-e23f-4d27-b92d-3c008073f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.740705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00adf6e-e23f-4d27-b92d-3c008073f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.740987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00adf6e-e23f-4d27-b92d-3c008073f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.741262 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00adf6e-e23f-4d27-b92d-3c008073f3b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.741982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00adf6e-e23f-4d27-b92d-3c008073f3b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:16.742287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00adf6e-e23f-4d27-b92d-3c008073f3b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:16.743682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00adf6e-e23f-4d27-b92d-3c008073f3b2 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2a6f7d39-4d52-4db5-ba8f-ea2240087a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:16.746540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:16.747568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:16.748653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:16.748653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:16.748653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:16.748653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:16.750531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 243/491] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:16.751932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea2a6d-d0bd-4ec1-8582-1f509c05c02d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.752368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea2a6d-d0bd-4ec1-8582-1f509c05c02d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.752794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea2a6d-d0bd-4ec1-8582-1f509c05c02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.762219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 249/492] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:16.763635 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6154-7bea-4b3a-bf5c-8ce1be9453a6 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.763936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6154-7bea-4b3a-bf5c-8ce1be9453a6 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.764218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e6154-7bea-4b3a-bf5c-8ce1be9453a6 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.765508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 250/493] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:16.766201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6154-7bea-4b3a-bf5c-8ce1be9453a6 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.772566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-32ea2a6d-d0bd-4ec1-8582-1f509c05c02d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:16.773824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-32ea2a6d-d0bd-4ec1-8582-1f509c05c02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:16.850365 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 244/494] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:16.851086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea2a6d-d0bd-4ec1-8582-1f509c05c02d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:16.869467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:16.888906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:16.892763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e6154-7bea-4b3a-bf5c-8ce1be9453a6 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.928965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e482003-218a-4590-bcff-6d89ef7e4812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:16.929764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e482003-218a-4590-bcff-6d89ef7e4812 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.930105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e482003-218a-4590-bcff-6d89ef7e4812 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.930400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e482003-218a-4590-bcff-6d89ef7e4812 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.937886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e482003-218a-4590-bcff-6d89ef7e4812 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:16.939344 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e482003-218a-4590-bcff-6d89ef7e4812 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:16.961448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea2a6d-d0bd-4ec1-8582-1f509c05c02d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-8e482003-218a-4590-bcff-6d89ef7e4812 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:16.961643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:16.962518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:16.963495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:16.963495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:16.963495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:16.963495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:16.963495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:16.963495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:16.963495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:16.963495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:16.963495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:16.963495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:16.963495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 251/495] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:16.964586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac09519-a951-4a77-bcc8-221451e4ea0d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:16.964586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac09519-a951-4a77-bcc8-221451e4ea0d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:16.964714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac09519-a951-4a77-bcc8-221451e4ea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:16.981131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-1ac09519-a951-4a77-bcc8-221451e4ea0d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:16.982328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1ac09519-a951-4a77-bcc8-221451e4ea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:17.002148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc223c1-b3b1-4b06-8637-c8cfe324b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.002820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc223c1-b3b1-4b06-8637-c8cfe324b7ee None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.003105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc223c1-b3b1-4b06-8637-c8cfe324b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.003383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc223c1-b3b1-4b06-8637-c8cfe324b7ee None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.004158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc223c1-b3b1-4b06-8637-c8cfe324b7ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:17.004522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc223c1-b3b1-4b06-8637-c8cfe324b7ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:17.006550 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc223c1-b3b1-4b06-8637-c8cfe324b7ee None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:17.018734 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 245/496] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:17.024488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc223c1-b3b1-4b06-8637-c8cfe324b7ee None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.058391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 252/497] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:17.059138 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac09519-a951-4a77-bcc8-221451e4ea0d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.124061 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.154924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc223c1-b3b1-4b06-8637-c8cfe324b7ee None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.159675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.169248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac09519-a951-4a77-bcc8-221451e4ea0d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.194089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed6542-2ac3-4815-aa6e-8fe35219fd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.194887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed6542-2ac3-4815-aa6e-8fe35219fd3c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.195179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed6542-2ac3-4815-aa6e-8fe35219fd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.195435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed6542-2ac3-4815-aa6e-8fe35219fd3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.204586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac18ca9-3b32-44e3-8514-6c34507d4e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.205372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18ca9-3b32-44e3-8514-6c34507d4e1d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.205738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18ca9-3b32-44e3-8514-6c34507d4e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.206092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac18ca9-3b32-44e3-8514-6c34507d4e1d None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.206744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed6542-2ac3-4815-aa6e-8fe35219fd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:17.206952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac18ca9-3b32-44e3-8514-6c34507d4e1d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:17.207268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac18ca9-3b32-44e3-8514-6c34507d4e1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:17.209316 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac18ca9-3b32-44e3-8514-6c34507d4e1d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-a9ed6542-2ac3-4815-aa6e-8fe35219fd3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:17.216139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:17.217030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:17.217873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:17.220278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 246/498] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:17.221270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed6542-2ac3-4815-aa6e-8fe35219fd3c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.248405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 253/499] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:17.249283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac18ca9-3b32-44e3-8514-6c34507d4e1d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.337349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed6542-2ac3-4815-aa6e-8fe35219fd3c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.356118 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac18ca9-3b32-44e3-8514-6c34507d4e1d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.373240 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3835519-fa8b-4f05-b3d6-09a988f95386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.374451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3835519-fa8b-4f05-b3d6-09a988f95386 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.374742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3835519-fa8b-4f05-b3d6-09a988f95386 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.375020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3835519-fa8b-4f05-b3d6-09a988f95386 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.377910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.384857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3835519-fa8b-4f05-b3d6-09a988f95386 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:17.386413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3835519-fa8b-4f05-b3d6-09a988f95386 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:17.391624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd151aa1-414e-4055-84c8-91f00ec4f8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.392422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151aa1-414e-4055-84c8-91f00ec4f8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.392704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151aa1-414e-4055-84c8-91f00ec4f8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.392983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd151aa1-414e-4055-84c8-91f00ec4f8c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.403361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd151aa1-414e-4055-84c8-91f00ec4f8c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-c3835519-fa8b-4f05-b3d6-09a988f95386 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:17.403569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:17.404457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 247/500] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:17.410192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3835519-fa8b-4f05-b3d6-09a988f95386 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-fd151aa1-414e-4055-84c8-91f00ec4f8c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:17.411315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:17.412230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:17.413024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 254/501] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:17.413684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd151aa1-414e-4055-84c8-91f00ec4f8c5 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.425073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.515230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd151aa1-414e-4055-84c8-91f00ec4f8c5 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.517875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3835519-fa8b-4f05-b3d6-09a988f95386 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.548075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b778a9-712e-40bc-9bb2-165e52ac09c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.548752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b778a9-712e-40bc-9bb2-165e52ac09c4 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.548993 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b778a9-712e-40bc-9bb2-165e52ac09c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.549268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b778a9-712e-40bc-9bb2-165e52ac09c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.551599 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6811ce2-453d-4ddc-ba32-566ebc46d481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.552266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6811ce2-453d-4ddc-ba32-566ebc46d481 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.553109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6811ce2-453d-4ddc-ba32-566ebc46d481 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.553385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6811ce2-453d-4ddc-ba32-566ebc46d481 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.554129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6811ce2-453d-4ddc-ba32-566ebc46d481 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:17.554438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6811ce2-453d-4ddc-ba32-566ebc46d481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:17.555840 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6811ce2-453d-4ddc-ba32-566ebc46d481 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:17.564302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 248/502] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:17.565178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6811ce2-453d-4ddc-ba32-566ebc46d481 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.630148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.675469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6811ce2-453d-4ddc-ba32-566ebc46d481 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.709603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe8cac-1726-4841-8bfc-129be4c78e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.710268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe8cac-1726-4841-8bfc-129be4c78e80 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.710607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe8cac-1726-4841-8bfc-129be4c78e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.710886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe8cac-1726-4841-8bfc-129be4c78e80 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.711787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe8cac-1726-4841-8bfc-129be4c78e80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:17.712098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe8cac-1726-4841-8bfc-129be4c78e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:17.713520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe8cac-1726-4841-8bfc-129be4c78e80 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:17.746474 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b778a9-712e-40bc-9bb2-165e52ac09c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:17.747963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b778a9-712e-40bc-9bb2-165e52ac09c4 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:17.749909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 249/503] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:17.750923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe8cac-1726-4841-8bfc-129be4c78e80 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.758507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.844011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 255/504] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:17.845335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef527a6-5566-45ad-95c9-ad48db9e7fd2 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.845630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef527a6-5566-45ad-95c9-ad48db9e7fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.845914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef527a6-5566-45ad-95c9-ad48db9e7fd2 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.851771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 256/505] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:17.851771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef527a6-5566-45ad-95c9-ad48db9e7fd2 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.855069 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe8cac-1726-4841-8bfc-129be4c78e80 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.871786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.891253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3144e-e842-4540-889c-624f7195ff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.892045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3144e-e842-4540-889c-624f7195ff75 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.892476 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3144e-e842-4540-889c-624f7195ff75 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.892761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3144e-e842-4540-889c-624f7195ff75 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.893514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3144e-e842-4540-889c-624f7195ff75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:17.893831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3144e-e842-4540-889c-624f7195ff75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:17.895198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3144e-e842-4540-889c-624f7195ff75 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:17.905178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 250/506] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:17.906164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3144e-e842-4540-889c-624f7195ff75 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:17.952375 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef527a6-5566-45ad-95c9-ad48db9e7fd2 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:17.962143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:17.986383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b59344-0322-4c55-aa39-6bfbeb431de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:17.987204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b59344-0322-4c55-aa39-6bfbeb431de6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:17.987488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b59344-0322-4c55-aa39-6bfbeb431de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:17.987797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b59344-0322-4c55-aa39-6bfbeb431de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:17.999105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b59344-0322-4c55-aa39-6bfbeb431de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.000552 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b59344-0322-4c55-aa39-6bfbeb431de6 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.004448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3144e-e842-4540-889c-624f7195ff75 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-96b59344-0322-4c55-aa39-6bfbeb431de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:18.018311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:18.019354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:18.020267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:18.020267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:18.020267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:18.020267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:18.020267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 257/507] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:18.020267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b59344-0322-4c55-aa39-6bfbeb431de6 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.043554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3be513-14a5-4fe9-b3d1-6400058a8484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.044232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3be513-14a5-4fe9-b3d1-6400058a8484 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.046867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3be513-14a5-4fe9-b3d1-6400058a8484 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.046867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3be513-14a5-4fe9-b3d1-6400058a8484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.105050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.120663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b59344-0322-4c55-aa39-6bfbeb431de6 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.127713 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3be513-14a5-4fe9-b3d1-6400058a8484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.130084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3be513-14a5-4fe9-b3d1-6400058a8484 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.155057 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5437d16-666e-40cb-b748-9f5e6d7b65f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.155871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437d16-666e-40cb-b748-9f5e6d7b65f1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.156151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437d16-666e-40cb-b748-9f5e6d7b65f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.156436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5437d16-666e-40cb-b748-9f5e6d7b65f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.166677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5437d16-666e-40cb-b748-9f5e6d7b65f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.168126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5437d16-666e-40cb-b748-9f5e6d7b65f1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-a5437d16-666e-40cb-b748-9f5e6d7b65f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:18.185087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:18.185952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:18.186813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:18.186813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:18.186813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:18.186813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:18.186813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 258/508] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:18.187377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fdbca-9bcc-420a-9fd9-bc95d3dc594a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.187692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fdbca-9bcc-420a-9fd9-bc95d3dc594a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.187953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fdbca-9bcc-420a-9fd9-bc95d3dc594a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.203949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b09fdbca-9bcc-420a-9fd9-bc95d3dc594a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:18.205126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b09fdbca-9bcc-420a-9fd9-bc95d3dc594a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:18.212279 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.236336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 251/509] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:18.237168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3be513-14a5-4fe9-b3d1-6400058a8484 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.273602 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 259/510] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:18.274448 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fdbca-9bcc-420a-9fd9-bc95d3dc594a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.317169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.340109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3be513-14a5-4fe9-b3d1-6400058a8484 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.372846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a19b6-c50b-44d0-a007-d6b31293e838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.373544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a19b6-c50b-44d0-a007-d6b31293e838 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.373826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a19b6-c50b-44d0-a007-d6b31293e838 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.374098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a19b6-c50b-44d0-a007-d6b31293e838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.384324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fdbca-9bcc-420a-9fd9-bc95d3dc594a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.384516 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a19b6-c50b-44d0-a007-d6b31293e838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.385954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a19b6-c50b-44d0-a007-d6b31293e838 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-900a19b6-c50b-44d0-a007-d6b31293e838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:18.403915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:18.404825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:18.405683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:18.405683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:18.405683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:18.405683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:18.405683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 252/511] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:18.405959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a19b6-c50b-44d0-a007-d6b31293e838 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.421866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dd346-a428-4ee4-9b6d-c97ec58e9647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.422540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd346-a428-4ee4-9b6d-c97ec58e9647 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.422830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd346-a428-4ee4-9b6d-c97ec58e9647 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.423112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd346-a428-4ee4-9b6d-c97ec58e9647 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.423872 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dd346-a428-4ee4-9b6d-c97ec58e9647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:18.424183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dd346-a428-4ee4-9b6d-c97ec58e9647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.425554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dd346-a428-4ee4-9b6d-c97ec58e9647 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.436574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 260/512] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:18.437356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dd346-a428-4ee4-9b6d-c97ec58e9647 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.441452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.504120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a19b6-c50b-44d0-a007-d6b31293e838 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.532096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.536050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dd346-a428-4ee4-9b6d-c97ec58e9647 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.538405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8cf1a-a7aa-4aac-946f-26b63726d8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.539068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cf1a-a7aa-4aac-946f-26b63726d8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.539357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cf1a-a7aa-4aac-946f-26b63726d8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.539676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8cf1a-a7aa-4aac-946f-26b63726d8e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.540433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8cf1a-a7aa-4aac-946f-26b63726d8e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:18.544032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8cf1a-a7aa-4aac-946f-26b63726d8e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.544032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8cf1a-a7aa-4aac-946f-26b63726d8e4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.554110 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 253/513] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:18.554918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8cf1a-a7aa-4aac-946f-26b63726d8e4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.572537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a47397-3015-450c-ad2c-ba7ec94258a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.573339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47397-3015-450c-ad2c-ba7ec94258a4 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.573626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47397-3015-450c-ad2c-ba7ec94258a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.573908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a47397-3015-450c-ad2c-ba7ec94258a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.584444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a47397-3015-450c-ad2c-ba7ec94258a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.585866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a47397-3015-450c-ad2c-ba7ec94258a4 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-a1a47397-3015-450c-ad2c-ba7ec94258a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:18.603047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:18.604105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:18.605017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:18.605017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:18.605017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:18.605017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:18.605017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 261/514] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:18.605526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a47397-3015-450c-ad2c-ba7ec94258a4 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.656668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8cf1a-a7aa-4aac-946f-26b63726d8e4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.659956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.690093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb71ce-4d9b-413a-901e-1b99b9a5c976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.690856 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb71ce-4d9b-413a-901e-1b99b9a5c976 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.691133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb71ce-4d9b-413a-901e-1b99b9a5c976 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.691404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb71ce-4d9b-413a-901e-1b99b9a5c976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.702278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb71ce-4d9b-413a-901e-1b99b9a5c976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.703764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb71ce-4d9b-413a-901e-1b99b9a5c976 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.704949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a47397-3015-450c-ad2c-ba7ec94258a4 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-67eb71ce-4d9b-413a-901e-1b99b9a5c976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:18.721326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:18.722267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:18.723114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:18.723114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:18.723114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:18.723114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:18.723114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 254/515] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:18.723376 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb71ce-4d9b-413a-901e-1b99b9a5c976 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.742812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f302-d14a-4f3e-9d69-c5056e536c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.743479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f302-d14a-4f3e-9d69-c5056e536c45 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.743796 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f302-d14a-4f3e-9d69-c5056e536c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.744075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05f302-d14a-4f3e-9d69-c5056e536c45 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.744795 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05f302-d14a-4f3e-9d69-c5056e536c45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:18.745106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05f302-d14a-4f3e-9d69-c5056e536c45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.746465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05f302-d14a-4f3e-9d69-c5056e536c45 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.758310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 262/516] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:18.759096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f302-d14a-4f3e-9d69-c5056e536c45 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.767786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.833689 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb71ce-4d9b-413a-901e-1b99b9a5c976 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.860686 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05f302-d14a-4f3e-9d69-c5056e536c45 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:18.866659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbc04d-da1f-426f-bffa-0ca102e2c6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.867450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbc04d-da1f-426f-bffa-0ca102e2c6ae None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.867761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbc04d-da1f-426f-bffa-0ca102e2c6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.868037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbc04d-da1f-426f-bffa-0ca102e2c6ae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.875724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:18.876573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbc04d-da1f-426f-bffa-0ca102e2c6ae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.878091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbc04d-da1f-426f-bffa-0ca102e2c6ae None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-0edbc04d-da1f-426f-bffa-0ca102e2c6ae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:18.893047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:18.893981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:18.894877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:18.894877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:18.894877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:18.894877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:18.894877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:18.894877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:18.894877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:18.894877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:18.894877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:18.894877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:18.894877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 255/517] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:18.896528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbc04d-da1f-426f-bffa-0ca102e2c6ae None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:18.898307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44408955-f858-461a-893c-9023cb60cdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:18.899218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44408955-f858-461a-893c-9023cb60cdfe None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:18.899497 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44408955-f858-461a-893c-9023cb60cdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:18.899793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44408955-f858-461a-893c-9023cb60cdfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:18.907232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44408955-f858-461a-893c-9023cb60cdfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:18.908913 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44408955-f858-461a-893c-9023cb60cdfe None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-44408955-f858-461a-893c-9023cb60cdfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:18.923919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:18.924804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:18.925692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:18.925692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:18.925692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:18.925692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:18.925692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:18.925692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:18.925692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:18.925692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:18.925692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 263/518] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:18.926156 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44408955-f858-461a-893c-9023cb60cdfe None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.000280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbc04d-da1f-426f-bffa-0ca102e2c6ae None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.001780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:19.023116 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44408955-f858-461a-893c-9023cb60cdfe None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.034956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a21cb-234d-42b7-9859-acb52b31768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.035640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a21cb-234d-42b7-9859-acb52b31768d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.035932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a21cb-234d-42b7-9859-acb52b31768d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.036216 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a21cb-234d-42b7-9859-acb52b31768d None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.037707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a21cb-234d-42b7-9859-acb52b31768d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:19.038023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a21cb-234d-42b7-9859-acb52b31768d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.039394 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a21cb-234d-42b7-9859-acb52b31768d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.051642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 256/519] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:19.052488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a21cb-234d-42b7-9859-acb52b31768d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.060906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7df220-afd8-4e9c-b2a4-a243ff5762fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.061613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7df220-afd8-4e9c-b2a4-a243ff5762fa None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.061895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7df220-afd8-4e9c-b2a4-a243ff5762fa None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.062171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7df220-afd8-4e9c-b2a4-a243ff5762fa None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.062890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7df220-afd8-4e9c-b2a4-a243ff5762fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:19.063199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7df220-afd8-4e9c-b2a4-a243ff5762fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.064590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7df220-afd8-4e9c-b2a4-a243ff5762fa None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.077576 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 264/520] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:19.078370 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7df220-afd8-4e9c-b2a4-a243ff5762fa None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.112799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:19.152380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a21cb-234d-42b7-9859-acb52b31768d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.179781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7df220-afd8-4e9c-b2a4-a243ff5762fa None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.185439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaffaf-83c6-445c-9405-c75ddccf273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.186227 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaffaf-83c6-445c-9405-c75ddccf273f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.186514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaffaf-83c6-445c-9405-c75ddccf273f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.186793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaffaf-83c6-445c-9405-c75ddccf273f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.193814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaffaf-83c6-445c-9405-c75ddccf273f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.195250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaffaf-83c6-445c-9405-c75ddccf273f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-afdaffaf-83c6-445c-9405-c75ddccf273f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:19.209460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:19.210366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:19.211253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:19.211253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:19.211253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:19.211253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:19.211253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:19.211253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:19.211253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:19.211253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:19.211253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:19.211253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:19.211253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 257/521] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:19.211960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaffaf-83c6-445c-9405-c75ddccf273f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.214603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6b71-e5f0-4167-b46f-8c3e659abbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.215276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6b71-e5f0-4167-b46f-8c3e659abbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.215571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6b71-e5f0-4167-b46f-8c3e659abbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.215864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd6b71-e5f0-4167-b46f-8c3e659abbe7 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.216700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd6b71-e5f0-4167-b46f-8c3e659abbe7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:19.217013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd6b71-e5f0-4167-b46f-8c3e659abbe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.218446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd6b71-e5f0-4167-b46f-8c3e659abbe7 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.236438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 265/522] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:19.237438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6b71-e5f0-4167-b46f-8c3e659abbe7 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.239226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:19.315185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaffaf-83c6-445c-9405-c75ddccf273f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.326490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:19.335240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd6b71-e5f0-4167-b46f-8c3e659abbe7 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.349011 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b3c28-605f-4ece-b24f-dd6281d7038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.350292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b3c28-605f-4ece-b24f-dd6281d7038c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.350571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b3c28-605f-4ece-b24f-dd6281d7038c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.350849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b3c28-605f-4ece-b24f-dd6281d7038c None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.351667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b3c28-605f-4ece-b24f-dd6281d7038c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:19.351981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b3c28-605f-4ece-b24f-dd6281d7038c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.353442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b3c28-605f-4ece-b24f-dd6281d7038c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.368690 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2d588-7034-47c9-b35c-cea54741a878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.369487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d588-7034-47c9-b35c-cea54741a878 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.369768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d588-7034-47c9-b35c-cea54741a878 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.370043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d588-7034-47c9-b35c-cea54741a878 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.376500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 258/523] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:19.376500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b3c28-605f-4ece-b24f-dd6281d7038c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.378628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2d588-7034-47c9-b35c-cea54741a878 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.380140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2d588-7034-47c9-b35c-cea54741a878 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-cbf2d588-7034-47c9-b35c-cea54741a878 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:19.394103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:19.395221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:19.396693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:19.396693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:19.396693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:19.396693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:19.396693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:19.396693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:19.396693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:19.396693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:19.396693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 266/524] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:19.396693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2d588-7034-47c9-b35c-cea54741a878 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.455299 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:19.473438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b3c28-605f-4ece-b24f-dd6281d7038c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.501400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2d588-7034-47c9-b35c-cea54741a878 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.510903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec37914-e46c-41ea-a09b-af2e864d396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.511568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec37914-e46c-41ea-a09b-af2e864d396d None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.511886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec37914-e46c-41ea-a09b-af2e864d396d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.512166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec37914-e46c-41ea-a09b-af2e864d396d None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.512872 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec37914-e46c-41ea-a09b-af2e864d396d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.514314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec37914-e46c-41ea-a09b-af2e864d396d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.535558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4be0-cc3f-4ab7-8c14-e1dba0a93d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.536252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4be0-cc3f-4ab7-8c14-e1dba0a93d88 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.536575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4be0-cc3f-4ab7-8c14-e1dba0a93d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.536925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f4be0-cc3f-4ab7-8c14-e1dba0a93d88 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.537762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f4be0-cc3f-4ab7-8c14-e1dba0a93d88 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:19.541924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f4be0-cc3f-4ab7-8c14-e1dba0a93d88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.541924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f4be0-cc3f-4ab7-8c14-e1dba0a93d88 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.556834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 267/525] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:19.557616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4be0-cc3f-4ab7-8c14-e1dba0a93d88 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.570998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:19.605123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 259/526] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:19 2022] POST /identity/v3/users => generated 247 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:19.606076 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec37914-e46c-41ea-a09b-af2e864d396d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.664797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f4be0-cc3f-4ab7-8c14-e1dba0a93d88 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.710248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bf0d4-00c0-432d-94fa-61a390a25e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.711237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bf0d4-00c0-432d-94fa-61a390a25e8c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.711527 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bf0d4-00c0-432d-94fa-61a390a25e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.711894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bf0d4-00c0-432d-94fa-61a390a25e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.719797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec37914-e46c-41ea-a09b-af2e864d396d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.756970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a0fc9-a7ab-46b0-8ff6-6d53feb19154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.757631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0fc9-a7ab-46b0-8ff6-6d53feb19154 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.758028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0fc9-a7ab-46b0-8ff6-6d53feb19154 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.758305 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a0fc9-a7ab-46b0-8ff6-6d53feb19154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.759150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a0fc9-a7ab-46b0-8ff6-6d53feb19154 None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=ba690590103a4019a56b191e8dfe3231) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:19.759616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a0fc9-a7ab-46b0-8ff6-6d53feb19154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.761059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5a0fc9-a7ab-46b0-8ff6-6d53feb19154 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.775616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 260/527] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/role_assignments?user.id=ba690590103a4019a56b191e8dfe3231&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:19.775616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a0fc9-a7ab-46b0-8ff6-6d53feb19154 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.775616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:19.799888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bf0d4-00c0-432d-94fa-61a390a25e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.801462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bf0d4-00c0-432d-94fa-61a390a25e8c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.817341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:19.925463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5a0fc9-a7ab-46b0-8ff6-6d53feb19154 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:19.951702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 268/528] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:19.952712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bf0d4-00c0-432d-94fa-61a390a25e8c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:19.972792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e07f2-d1bc-405b-ab50-cb6aab768678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:19.973392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e07f2-d1bc-405b-ab50-cb6aab768678 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:19.973677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e07f2-d1bc-405b-ab50-cb6aab768678 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:19.974013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e07f2-d1bc-405b-ab50-cb6aab768678 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:19.975401 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e07f2-d1bc-405b-ab50-cb6aab768678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:19.976353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e07f2-d1bc-405b-ab50-cb6aab768678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:19.978150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e07f2-d1bc-405b-ab50-cb6aab768678 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:19.995379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 261/529] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:19.996928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e07f2-d1bc-405b-ab50-cb6aab768678 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.062776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bf0d4-00c0-432d-94fa-61a390a25e8c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.077600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.084884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.100396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55adc06-ce8b-42af-bfad-5230c289d13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.101143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55adc06-ce8b-42af-bfad-5230c289d13d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.101564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55adc06-ce8b-42af-bfad-5230c289d13d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.101844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55adc06-ce8b-42af-bfad-5230c289d13d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.126794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e07f2-d1bc-405b-ab50-cb6aab768678 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.172532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d04ce-589b-4237-b4da-b71e3b5560f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.174050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d04ce-589b-4237-b4da-b71e3b5560f9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.174481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d04ce-589b-4237-b4da-b71e3b5560f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.175146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d04ce-589b-4237-b4da-b71e3b5560f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.175655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55adc06-ce8b-42af-bfad-5230c289d13d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.177112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55adc06-ce8b-42af-bfad-5230c289d13d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.188792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d04ce-589b-4237-b4da-b71e3b5560f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.191089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d04ce-589b-4237-b4da-b71e3b5560f9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-795d04ce-589b-4237-b4da-b71e3b5560f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:20.216156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:20.217235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:20.218292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:20.218292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:20.218292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:20.218292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:20.220943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 262/530] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:20.222018 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d04ce-589b-4237-b4da-b71e3b5560f9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.303173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 269/531] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:20.304150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55adc06-ce8b-42af-bfad-5230c289d13d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.317619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.334782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d04ce-589b-4237-b4da-b71e3b5560f9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.349976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.371503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb62f6-e98a-4900-b798-864cea792e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.372195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb62f6-e98a-4900-b798-864cea792e26 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.372479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb62f6-e98a-4900-b798-864cea792e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.372765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb62f6-e98a-4900-b798-864cea792e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.373607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb62f6-e98a-4900-b798-864cea792e26 None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=10d089c711a94b70a198e35443ee7ea5) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:20.373930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb62f6-e98a-4900-b798-864cea792e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.375400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb62f6-e98a-4900-b798-864cea792e26 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.382039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 263/532] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/role_assignments?user.id=10d089c711a94b70a198e35443ee7ea5&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:20.382936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb62f6-e98a-4900-b798-864cea792e26 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.410890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55adc06-ce8b-42af-bfad-5230c289d13d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.449128 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2cf70-9d13-4c44-acce-0e24db7f1896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.449852 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2cf70-9d13-4c44-acce-0e24db7f1896 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.450139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2cf70-9d13-4c44-acce-0e24db7f1896 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.450415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2cf70-9d13-4c44-acce-0e24db7f1896 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.451153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2cf70-9d13-4c44-acce-0e24db7f1896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:20.451460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2cf70-9d13-4c44-acce-0e24db7f1896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.452901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2cf70-9d13-4c44-acce-0e24db7f1896 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.466627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 270/533] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:20.476697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2cf70-9d13-4c44-acce-0e24db7f1896 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.569513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb62f6-e98a-4900-b798-864cea792e26 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.617071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.627254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97578df9-d43d-4e1e-9954-3f1fff3dd7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.628425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578df9-d43d-4e1e-9954-3f1fff3dd7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.628916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578df9-d43d-4e1e-9954-3f1fff3dd7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.631084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97578df9-d43d-4e1e-9954-3f1fff3dd7f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.649080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97578df9-d43d-4e1e-9954-3f1fff3dd7f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.650916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97578df9-d43d-4e1e-9954-3f1fff3dd7f0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-97578df9-d43d-4e1e-9954-3f1fff3dd7f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:20.671717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:20.672646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:20.673494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:20.673494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:20.673494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:20.673494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:20.675786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 264/534] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:20.681679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97578df9-d43d-4e1e-9954-3f1fff3dd7f0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.689452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2cf70-9d13-4c44-acce-0e24db7f1896 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.740043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:20.759911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5352b02-d1c2-4e18-9c34-35e0cb8ec8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.760710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5352b02-d1c2-4e18-9c34-35e0cb8ec8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.760998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5352b02-d1c2-4e18-9c34-35e0cb8ec8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.761277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5352b02-d1c2-4e18-9c34-35e0cb8ec8a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.780444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5352b02-d1c2-4e18-9c34-35e0cb8ec8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.782228 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5352b02-d1c2-4e18-9c34-35e0cb8ec8a2 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-b5352b02-d1c2-4e18-9c34-35e0cb8ec8a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:20.816611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:20.818450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:20.819797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:20.819797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:20.819797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:20.819797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:20.819797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:20.819797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:20.819797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:20.819797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:20.822296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 271/535] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:20.835345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97578df9-d43d-4e1e-9954-3f1fff3dd7f0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:20.837124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5352b02-d1c2-4e18-9c34-35e0cb8ec8a2 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:20.871778 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3c7c5-f8b6-4f17-afa6-e28e1ee71ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:20.872496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c7c5-f8b6-4f17-afa6-e28e1ee71ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:20.872780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c7c5-f8b6-4f17-afa6-e28e1ee71ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:20.873058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3c7c5-f8b6-4f17-afa6-e28e1ee71ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:20.873936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3c7c5-f8b6-4f17-afa6-e28e1ee71ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:20.874256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3c7c5-f8b6-4f17-afa6-e28e1ee71ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:20.875705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3c7c5-f8b6-4f17-afa6-e28e1ee71ce3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:20.889494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 265/536] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:20.895312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3c7c5-f8b6-4f17-afa6-e28e1ee71ce3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:21.007959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:21.012341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3c7c5-f8b6-4f17-afa6-e28e1ee71ce3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.037064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5352b02-d1c2-4e18-9c34-35e0cb8ec8a2 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.064855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca0e43-c300-46a4-bf46-9bd49cd7c5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.066036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0e43-c300-46a4-bf46-9bd49cd7c5df None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.066538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0e43-c300-46a4-bf46-9bd49cd7c5df None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.067015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0e43-c300-46a4-bf46-9bd49cd7c5df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.075671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca0e43-c300-46a4-bf46-9bd49cd7c5df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.077943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca0e43-c300-46a4-bf46-9bd49cd7c5df None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-daca0e43-c300-46a4-bf46-9bd49cd7c5df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:21.095848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:21.096754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:21.097659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:21.097659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:21.097659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:21.097659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:21.097659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:21.097659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:21.097659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:21.097659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:21.100989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 266/537] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:21.112495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:21.114308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca0e43-c300-46a4-bf46-9bd49cd7c5df None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:21.119351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1225b5b-b5ce-4c08-8269-1aaa61bd6271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.120108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225b5b-b5ce-4c08-8269-1aaa61bd6271 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.124567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225b5b-b5ce-4c08-8269-1aaa61bd6271 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.124567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225b5b-b5ce-4c08-8269-1aaa61bd6271 None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.124567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1225b5b-b5ce-4c08-8269-1aaa61bd6271 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:21.124567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1225b5b-b5ce-4c08-8269-1aaa61bd6271 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.124567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1225b5b-b5ce-4c08-8269-1aaa61bd6271 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.141961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 272/538] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:21.147782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1225b5b-b5ce-4c08-8269-1aaa61bd6271 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:21.259050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1225b5b-b5ce-4c08-8269-1aaa61bd6271 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.297479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc7c36-6842-4b22-a552-234c1378135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.298246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc7c36-6842-4b22-a552-234c1378135d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.298595 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc7c36-6842-4b22-a552-234c1378135d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.298952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc7c36-6842-4b22-a552-234c1378135d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.300612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc7c36-6842-4b22-a552-234c1378135d None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=d9263fa2ac534b7b9e5c6658c871da9d) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:21.301001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc7c36-6842-4b22-a552-234c1378135d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.302543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc7c36-6842-4b22-a552-234c1378135d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.309166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 273/539] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:21 2022] GET /identity/v3/role_assignments?user.id=d9263fa2ac534b7b9e5c6658c871da9d&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:21.344478 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca0e43-c300-46a4-bf46-9bd49cd7c5df None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.387193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11ed85-6a7b-41b8-81ae-0998c17ff9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.388199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ed85-6a7b-41b8-81ae-0998c17ff9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.388723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ed85-6a7b-41b8-81ae-0998c17ff9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.389214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11ed85-6a7b-41b8-81ae-0998c17ff9f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.390246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11ed85-6a7b-41b8-81ae-0998c17ff9f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:21.390743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11ed85-6a7b-41b8-81ae-0998c17ff9f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.392393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11ed85-6a7b-41b8-81ae-0998c17ff9f1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.414983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 267/540] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:21.420732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc7c36-6842-4b22-a552-234c1378135d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:21.504271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:21.552520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc7c36-6842-4b22-a552-234c1378135d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:21.595209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f4a28-7f3e-4ecf-8149-4fe722e140c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:21.595819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4a28-7f3e-4ecf-8149-4fe722e140c6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:21.596104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4a28-7f3e-4ecf-8149-4fe722e140c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:21.596381 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4a28-7f3e-4ecf-8149-4fe722e140c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:21.597214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4a28-7f3e-4ecf-8149-4fe722e140c6 None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=0faacba133664123b4046de741073bc8) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:21.597528 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4a28-7f3e-4ecf-8149-4fe722e140c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:21.598954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4a28-7f3e-4ecf-8149-4fe722e140c6 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:21.605944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 274/541] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:21 2022] GET /identity/v3/role_assignments?user.id=0faacba133664123b4046de741073bc8&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:22.231943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab068-878a-44f9-ad53-fa351949d522 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.232430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab068-878a-44f9-ad53-fa351949d522 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.232430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab068-878a-44f9-ad53-fa351949d522 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.234067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 268/542] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:22.239094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376530-d374-4994-a06a-f0fd5ed8891b None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.239478 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376530-d374-4994-a06a-f0fd5ed8891b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.239764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38376530-d374-4994-a06a-f0fd5ed8891b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.260569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-38376530-d374-4994-a06a-f0fd5ed8891b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:22.261766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-38376530-d374-4994-a06a-f0fd5ed8891b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:22.345938 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 275/543] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:22.382243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ab068-878a-44f9-ad53-fa351949d522 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.404123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b6bb3-646a-4225-8289-8788931ebd4d None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.404123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b6bb3-646a-4225-8289-8788931ebd4d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.404123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b6bb3-646a-4225-8289-8788931ebd4d None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.404123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 276/544] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:22.405129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25bb58-088c-480a-8af4-e58b347df485 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.405419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25bb58-088c-480a-8af4-e58b347df485 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.405697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25bb58-088c-480a-8af4-e58b347df485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.407446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:22.425670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-6e25bb58-088c-480a-8af4-e58b347df485 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:22.426868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6e25bb58-088c-480a-8af4-e58b347df485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:22.492914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:22.531605 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 277/545] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:22.553676 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25bb58-088c-480a-8af4-e58b347df485 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.608246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ab068-878a-44f9-ad53-fa351949d522 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:22.649014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185dbe-ae0d-4353-9256-051b12a8e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:22.649817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185dbe-ae0d-4353-9256-051b12a8e324 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.650096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185dbe-ae0d-4353-9256-051b12a8e324 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.650367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8185dbe-ae0d-4353-9256-051b12a8e324 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.678533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8185dbe-ae0d-4353-9256-051b12a8e324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e8185dbe-ae0d-4353-9256-051b12a8e324 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:22.694190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:22.695191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:22.696412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 269/546] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:22.702928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185dbe-ae0d-4353-9256-051b12a8e324 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.730311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25bb58-088c-480a-8af4-e58b347df485 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:22.780339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607d27b-e2b6-489d-ab8f-90159f6b4b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:22.781523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d27b-e2b6-489d-ab8f-90159f6b4b28 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.782019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d27b-e2b6-489d-ab8f-90159f6b4b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.782509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0607d27b-e2b6-489d-ab8f-90159f6b4b28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.804711 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:22.812851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0607d27b-e2b6-489d-ab8f-90159f6b4b28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:22.825386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8185dbe-ae0d-4353-9256-051b12a8e324 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-0607d27b-e2b6-489d-ab8f-90159f6b4b28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:22.829786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:22.830759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:22.832031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 278/547] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:22.837321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607d27b-e2b6-489d-ab8f-90159f6b4b28 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.878634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b4369-3abe-415c-b9a6-8fa95e26a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:22.879607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4369-3abe-415c-b9a6-8fa95e26a60a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:22.881503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4369-3abe-415c-b9a6-8fa95e26a60a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:22.881986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b4369-3abe-415c-b9a6-8fa95e26a60a None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:22.882946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4369-3abe-415c-b9a6-8fa95e26a60a None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:22.886500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4369-3abe-415c-b9a6-8fa95e26a60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:22.888194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b4369-3abe-415c-b9a6-8fa95e26a60a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:22.905526 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 270/548] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:22.908294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b4369-3abe-415c-b9a6-8fa95e26a60a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:22.929205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:23.065970 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0607d27b-e2b6-489d-ab8f-90159f6b4b28 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.076641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b4369-3abe-415c-b9a6-8fa95e26a60a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.112241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:23.126068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49db56a-fca6-4a56-96f4-9d96d2ce2076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.126787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49db56a-fca6-4a56-96f4-9d96d2ce2076 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.127120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49db56a-fca6-4a56-96f4-9d96d2ce2076 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.127405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49db56a-fca6-4a56-96f4-9d96d2ce2076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.140934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4a2c7-cd76-4e77-b270-19dae9f61bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.141626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a2c7-cd76-4e77-b270-19dae9f61bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.141908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a2c7-cd76-4e77-b270-19dae9f61bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.142187 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a2c7-cd76-4e77-b270-19dae9f61bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.142947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4a2c7-cd76-4e77-b270-19dae9f61bf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:23.143262 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4a2c7-cd76-4e77-b270-19dae9f61bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.146850 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4a2c7-cd76-4e77-b270-19dae9f61bf1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.150290 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49db56a-fca6-4a56-96f4-9d96d2ce2076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.152040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49db56a-fca6-4a56-96f4-9d96d2ce2076 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.169866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 279/549] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-f49db56a-fca6-4a56-96f4-9d96d2ce2076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:23.170152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:23.171215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:23.176822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:23.176822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:23.176822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:23.176822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:23.179437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 271/550] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:23.183721 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4a2c7-cd76-4e77-b270-19dae9f61bf1 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.185712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49db56a-fca6-4a56-96f4-9d96d2ce2076 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.309685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:23.313003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4a2c7-cd76-4e77-b270-19dae9f61bf1 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.331888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49db56a-fca6-4a56-96f4-9d96d2ce2076 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.349555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dacba5-4aaa-46de-aa21-5b599bbfdd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.350733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dacba5-4aaa-46de-aa21-5b599bbfdd97 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.351096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dacba5-4aaa-46de-aa21-5b599bbfdd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.351452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dacba5-4aaa-46de-aa21-5b599bbfdd97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.362699 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819b560-bd0b-4c36-958f-251199649c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.363364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819b560-bd0b-4c36-958f-251199649c8e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.363675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819b560-bd0b-4c36-958f-251199649c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.363956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819b560-bd0b-4c36-958f-251199649c8e None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.364054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dacba5-4aaa-46de-aa21-5b599bbfdd97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.364782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819b560-bd0b-4c36-958f-251199649c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:23.365094 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819b560-bd0b-4c36-958f-251199649c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.365954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dacba5-4aaa-46de-aa21-5b599bbfdd97 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.366449 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819b560-bd0b-4c36-958f-251199649c8e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.384202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 272/551] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-78dacba5-4aaa-46de-aa21-5b599bbfdd97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:23.385380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:23.386218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:23.387073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:23.387073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:23.387073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:23.387073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:23.387295 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1529bc-9841-4223-ad99-e137c07514ab None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.387295 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1529bc-9841-4223-ad99-e137c07514ab None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.387295 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1529bc-9841-4223-ad99-e137c07514ab None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.387491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 280/552] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:23.387795 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 273/553] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:23.388946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dacba5-4aaa-46de-aa21-5b599bbfdd97 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.396910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1529bc-9841-4223-ad99-e137c07514ab None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.454504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:23.504427 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dacba5-4aaa-46de-aa21-5b599bbfdd97 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.524118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1529bc-9841-4223-ad99-e137c07514ab None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.543027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e61b96-0cd7-4108-a238-0dae1060a7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.543866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e61b96-0cd7-4108-a238-0dae1060a7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.544155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e61b96-0cd7-4108-a238-0dae1060a7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.544434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e61b96-0cd7-4108-a238-0dae1060a7a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.555910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e61b96-0cd7-4108-a238-0dae1060a7a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.557439 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e61b96-0cd7-4108-a238-0dae1060a7a6 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.568817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f407be9-34b3-4ad1-b4cf-67bcb7dbfb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.569893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f407be9-34b3-4ad1-b4cf-67bcb7dbfb1e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.570397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f407be9-34b3-4ad1-b4cf-67bcb7dbfb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.570893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f407be9-34b3-4ad1-b4cf-67bcb7dbfb1e None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.571881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f407be9-34b3-4ad1-b4cf-67bcb7dbfb1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:23.572425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f407be9-34b3-4ad1-b4cf-67bcb7dbfb1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.574013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f407be9-34b3-4ad1-b4cf-67bcb7dbfb1e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-17e61b96-0cd7-4108-a238-0dae1060a7a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:23.574296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:23.575197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 281/554] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:23.576798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9245b0-b9a5-4edb-87ec-e598adac6f00 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.577537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9245b0-b9a5-4edb-87ec-e598adac6f00 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.577537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9245b0-b9a5-4edb-87ec-e598adac6f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.593467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 274/555] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:23.595769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f407be9-34b3-4ad1-b4cf-67bcb7dbfb1e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.601341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-aa9245b0-b9a5-4edb-87ec-e598adac6f00 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:23.602097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-aa9245b0-b9a5-4edb-87ec-e598adac6f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:23.610331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:23.688531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 282/556] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:23.688531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9245b0-b9a5-4edb-87ec-e598adac6f00 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.748276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f407be9-34b3-4ad1-b4cf-67bcb7dbfb1e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.755019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:23.804441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044a54b-ddf5-4bcd-bbaa-a6e860e5c445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.805922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044a54b-ddf5-4bcd-bbaa-a6e860e5c445 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.806513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044a54b-ddf5-4bcd-bbaa-a6e860e5c445 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.807082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044a54b-ddf5-4bcd-bbaa-a6e860e5c445 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.808375 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044a54b-ddf5-4bcd-bbaa-a6e860e5c445 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:23.808852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044a54b-ddf5-4bcd-bbaa-a6e860e5c445 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.811171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044a54b-ddf5-4bcd-bbaa-a6e860e5c445 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.820141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9245b0-b9a5-4edb-87ec-e598adac6f00 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:23.848115 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 275/557] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:23.849529 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044a54b-ddf5-4bcd-bbaa-a6e860e5c445 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.873062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a765-9ee7-437d-ad11-99a6d9db6896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:23.874696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a765-9ee7-437d-ad11-99a6d9db6896 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:23.875147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a765-9ee7-437d-ad11-99a6d9db6896 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:23.875768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a765-9ee7-437d-ad11-99a6d9db6896 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:23.890272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1a765-9ee7-437d-ad11-99a6d9db6896 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:23.892674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1a765-9ee7-437d-ad11-99a6d9db6896 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-aff1a765-9ee7-437d-ad11-99a6d9db6896 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:23.914597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:23.916319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:23.917742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:23.917742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:23.917742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:23.917742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:23.917742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:23.917742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:23.917742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:23.917742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:23.917742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:23.917742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:23.921481 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 283/558] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:23.922714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a765-9ee7-437d-ad11-99a6d9db6896 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:23.930642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:24.009185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044a54b-ddf5-4bcd-bbaa-a6e860e5c445 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:24.075911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a765-9ee7-437d-ad11-99a6d9db6896 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:24.076970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39708e19-d484-4e8d-94aa-2d99bca970c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:24.077855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708e19-d484-4e8d-94aa-2d99bca970c7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.078229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708e19-d484-4e8d-94aa-2d99bca970c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.078521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708e19-d484-4e8d-94aa-2d99bca970c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.101201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39708e19-d484-4e8d-94aa-2d99bca970c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-39708e19-d484-4e8d-94aa-2d99bca970c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:24.112180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:24.113609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:24.114983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 276/559] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:24.116174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39708e19-d484-4e8d-94aa-2d99bca970c7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:24.125625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5b1ca-10ac-4b3d-8c24-3c41c3407f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:24.127460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b1ca-10ac-4b3d-8c24-3c41c3407f70 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.127884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b1ca-10ac-4b3d-8c24-3c41c3407f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.128264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5b1ca-10ac-4b3d-8c24-3c41c3407f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.145242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5b1ca-10ac-4b3d-8c24-3c41c3407f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:24.146659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:24.149260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5b1ca-10ac-4b3d-8c24-3c41c3407f70 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-68e5b1ca-10ac-4b3d-8c24-3c41c3407f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:24.173645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:24.174611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:24.175542 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:24.175542 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:24.175542 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:24.175542 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:24.179473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 284/560] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:24.180553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5b1ca-10ac-4b3d-8c24-3c41c3407f70 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:24.242896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39708e19-d484-4e8d-94aa-2d99bca970c7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:24.243623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:24.280198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270d20a-eb8f-487e-b271-48d2527b8489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:24.281217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270d20a-eb8f-487e-b271-48d2527b8489 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.281716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270d20a-eb8f-487e-b271-48d2527b8489 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.282001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270d20a-eb8f-487e-b271-48d2527b8489 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.282844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270d20a-eb8f-487e-b271-48d2527b8489 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:24.283194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270d20a-eb8f-487e-b271-48d2527b8489 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:24.284661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270d20a-eb8f-487e-b271-48d2527b8489 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:24.292614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5b1ca-10ac-4b3d-8c24-3c41c3407f70 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:24.303632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 277/561] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 2 09:54:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:24.304465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270d20a-eb8f-487e-b271-48d2527b8489 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:24.332270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bd9fe-32f2-40c9-9541-3b4d89477619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:24.332971 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bd9fe-32f2-40c9-9541-3b4d89477619 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.333450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bd9fe-32f2-40c9-9541-3b4d89477619 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.333561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bd9fe-32f2-40c9-9541-3b4d89477619 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.334264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bd9fe-32f2-40c9-9541-3b4d89477619 None admin] RBAC: Adding query filter params (name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:24.334576 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bd9fe-32f2-40c9-9541-3b4d89477619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:24.335972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bd9fe-32f2-40c9-9541-3b4d89477619 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:24.348509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 285/562] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:24.350846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549809ec-ee28-4663-afbd-8d6e72868193 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.351140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549809ec-ee28-4663-afbd-8d6e72868193 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.351650 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549809ec-ee28-4663-afbd-8d6e72868193 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.352892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 286/563] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:24.353587 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549809ec-ee28-4663-afbd-8d6e72868193 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:24.396496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:24.417882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270d20a-eb8f-487e-b271-48d2527b8489 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:24.454010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708db02a-202d-419e-b149-d826bb94411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:24.454675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db02a-202d-419e-b149-d826bb94411c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.454963 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db02a-202d-419e-b149-d826bb94411c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.455238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708db02a-202d-419e-b149-d826bb94411c None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.455991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708db02a-202d-419e-b149-d826bb94411c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:24.456302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708db02a-202d-419e-b149-d826bb94411c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:24.457666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708db02a-202d-419e-b149-d826bb94411c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:24.459040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549809ec-ee28-4663-afbd-8d6e72868193 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:24.469840 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 278/564] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:24.470637 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708db02a-202d-419e-b149-d826bb94411c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:24.477168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:24.494410 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8a874-60e6-427f-8387-21ec22f2aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:24.495062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a874-60e6-427f-8387-21ec22f2aabe None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.495348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a874-60e6-427f-8387-21ec22f2aabe None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.495658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a874-60e6-427f-8387-21ec22f2aabe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.563599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8a874-60e6-427f-8387-21ec22f2aabe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:24.565089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8a874-60e6-427f-8387-21ec22f2aabe None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:24.571274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708db02a-202d-419e-b149-d826bb94411c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:24.604145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1b1cd-abf5-41e5-8304-3e0f2d66978f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:24.604862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b1cd-abf5-41e5-8304-3e0f2d66978f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.605146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b1cd-abf5-41e5-8304-3e0f2d66978f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.605420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1b1cd-abf5-41e5-8304-3e0f2d66978f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.613906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:24.616218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1b1cd-abf5-41e5-8304-3e0f2d66978f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:24.617662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1b1cd-abf5-41e5-8304-3e0f2d66978f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-d0e1b1cd-abf5-41e5-8304-3e0f2d66978f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:24.635196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:24.639774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:24.640684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:24.640684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:24.640684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:24.640684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:24.640684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 279/565] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:24.640684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fa296-9516-4ca2-8b31-781dd0086954 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.640684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fa296-9516-4ca2-8b31-781dd0086954 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.640684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fa296-9516-4ca2-8b31-781dd0086954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.656932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-af6fa296-9516-4ca2-8b31-781dd0086954 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:24.658670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-af6fa296-9516-4ca2-8b31-781dd0086954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:24.663273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 287/566] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:24.664622 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458fb89-5091-4138-9ed4-4f660c285972 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.664915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458fb89-5091-4138-9ed4-4f660c285972 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.665196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458fb89-5091-4138-9ed4-4f660c285972 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.666599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 288/567] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:24.667140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458fb89-5091-4138-9ed4-4f660c285972 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:24.688554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:24.730988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 280/568] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:24.731868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fa296-9516-4ca2-8b31-781dd0086954 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:24.775839 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458fb89-5091-4138-9ed4-4f660c285972 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:24.813517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50eb19-49e7-43a2-a3bd-9c90d08ebf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:24.815042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50eb19-49e7-43a2-a3bd-9c90d08ebf6d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.815567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50eb19-49e7-43a2-a3bd-9c90d08ebf6d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.815955 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50eb19-49e7-43a2-a3bd-9c90d08ebf6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.823548 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50eb19-49e7-43a2-a3bd-9c90d08ebf6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:24.825059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50eb19-49e7-43a2-a3bd-9c90d08ebf6d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:24.836648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fa296-9516-4ca2-8b31-781dd0086954 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-2e50eb19-49e7-43a2-a3bd-9c90d08ebf6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:24.839046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:24.840208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:24.841097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:24.841097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:24.841097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:24.841097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:24.841097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:24.841097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:24.841097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:24.841097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:24.841097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 289/569] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:24.841097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50eb19-49e7-43a2-a3bd-9c90d08ebf6d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:24.863505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:24.876677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957a491-4c5a-49a5-b74b-212fe4689860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:24.877350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957a491-4c5a-49a5-b74b-212fe4689860 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.877636 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957a491-4c5a-49a5-b74b-212fe4689860 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.877915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957a491-4c5a-49a5-b74b-212fe4689860 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.878686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957a491-4c5a-49a5-b74b-212fe4689860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:24.878947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957a491-4c5a-49a5-b74b-212fe4689860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:24.880901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957a491-4c5a-49a5-b74b-212fe4689860 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:24.892378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 281/570] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:24.893625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ef9f5-1587-414a-b7f3-7e7007b1c274 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:24.893917 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ef9f5-1587-414a-b7f3-7e7007b1c274 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:24.894197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ef9f5-1587-414a-b7f3-7e7007b1c274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:24.911383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1c2ef9f5-1587-414a-b7f3-7e7007b1c274 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:24.912595 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1c2ef9f5-1587-414a-b7f3-7e7007b1c274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:24.929907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:24.953997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50eb19-49e7-43a2-a3bd-9c90d08ebf6d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:24.979489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 282/571] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:24.980359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ef9f5-1587-414a-b7f3-7e7007b1c274 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.018673 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd654b47-939e-49e3-a269-7834a3456346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:25.019484 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd654b47-939e-49e3-a269-7834a3456346 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:25.019797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd654b47-939e-49e3-a269-7834a3456346 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:25.020080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd654b47-939e-49e3-a269-7834a3456346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:25.031866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd654b47-939e-49e3-a269-7834a3456346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:25.033318 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd654b47-939e-49e3-a269-7834a3456346 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-bd654b47-939e-49e3-a269-7834a3456346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:25.051413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:25.052959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:25.053877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:25.053877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:25.053877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:25.053877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:25.053877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 290/572] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:25.054520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd654b47-939e-49e3-a269-7834a3456346 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.093196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ef9f5-1587-414a-b7f3-7e7007b1c274 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:25.106445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:25.127039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90db2b-a4ec-4e9e-83fa-93a1599f4882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:25.127791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90db2b-a4ec-4e9e-83fa-93a1599f4882 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:25.128076 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90db2b-a4ec-4e9e-83fa-93a1599f4882 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:25.128355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90db2b-a4ec-4e9e-83fa-93a1599f4882 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:25.138178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90db2b-a4ec-4e9e-83fa-93a1599f4882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2a90db2b-a4ec-4e9e-83fa-93a1599f4882 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:25.147210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:25.148225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:25.149089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 283/573] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:25.149784 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90db2b-a4ec-4e9e-83fa-93a1599f4882 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.157180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd654b47-939e-49e3-a269-7834a3456346 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:25.185077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:25.192693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66b48-f5b6-453c-b858-b4afeb6992f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:25.193457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66b48-f5b6-453c-b858-b4afeb6992f9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:25.193743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66b48-f5b6-453c-b858-b4afeb6992f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:25.194015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66b48-f5b6-453c-b858-b4afeb6992f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:25.194790 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66b48-f5b6-453c-b858-b4afeb6992f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:25.195099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66b48-f5b6-453c-b858-b4afeb6992f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:25.196558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66b48-f5b6-453c-b858-b4afeb6992f9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:25.208488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 291/574] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:25.209301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66b48-f5b6-453c-b858-b4afeb6992f9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.251593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90db2b-a4ec-4e9e-83fa-93a1599f4882 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:25.284624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2557417-fd2f-4f5a-8879-9e321870afbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:25.285524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557417-fd2f-4f5a-8879-9e321870afbb None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:25.285817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557417-fd2f-4f5a-8879-9e321870afbb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:25.286095 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2557417-fd2f-4f5a-8879-9e321870afbb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:25.294008 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2557417-fd2f-4f5a-8879-9e321870afbb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:25.295444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2557417-fd2f-4f5a-8879-9e321870afbb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:25.308204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66b48-f5b6-453c-b858-b4afeb6992f9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-b2557417-fd2f-4f5a-8879-9e321870afbb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:25.310027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:25.310976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 284/575] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:25.312313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2557417-fd2f-4f5a-8879-9e321870afbb None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.340993 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178fe52-39ee-4051-b2d0-444eed9972a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:25.341788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178fe52-39ee-4051-b2d0-444eed9972a8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:25.342070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178fe52-39ee-4051-b2d0-444eed9972a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:25.342347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178fe52-39ee-4051-b2d0-444eed9972a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:25.346054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:25.353675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178fe52-39ee-4051-b2d0-444eed9972a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-a178fe52-39ee-4051-b2d0-444eed9972a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:25.361443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:25.362457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:25.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 292/576] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:25.364028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178fe52-39ee-4051-b2d0-444eed9972a8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.414234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:25.418293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2557417-fd2f-4f5a-8879-9e321870afbb None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:25.451329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0aa35-10bb-45b5-9071-690b7008943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:25.452030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0aa35-10bb-45b5-9071-690b7008943b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:25.452324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0aa35-10bb-45b5-9071-690b7008943b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:25.452600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0aa35-10bb-45b5-9071-690b7008943b None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:25.453318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0aa35-10bb-45b5-9071-690b7008943b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:25.453626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0aa35-10bb-45b5-9071-690b7008943b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:25.455007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa0aa35-10bb-45b5-9071-690b7008943b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:25.464345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178fe52-39ee-4051-b2d0-444eed9972a8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:25.467818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 285/577] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:25.468425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0aa35-10bb-45b5-9071-690b7008943b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.498931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072e21f-de16-44a3-9d8e-d5dd31105e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:25.499628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072e21f-de16-44a3-9d8e-d5dd31105e5e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:25.499919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072e21f-de16-44a3-9d8e-d5dd31105e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:25.500203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072e21f-de16-44a3-9d8e-d5dd31105e5e None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:25.500949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072e21f-de16-44a3-9d8e-d5dd31105e5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:25.501262 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072e21f-de16-44a3-9d8e-d5dd31105e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:25.502633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072e21f-de16-44a3-9d8e-d5dd31105e5e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:25.510406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 293/578] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:25.511180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072e21f-de16-44a3-9d8e-d5dd31105e5e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.562373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:25.570966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0aa35-10bb-45b5-9071-690b7008943b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:25.605131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41ff13-d489-4ad2-8b32-e7d4f7349179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:25.606017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41ff13-d489-4ad2-8b32-e7d4f7349179 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:25.606419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41ff13-d489-4ad2-8b32-e7d4f7349179 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:25.606941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41ff13-d489-4ad2-8b32-e7d4f7349179 None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/ba690590103a4019a56b191e8dfe3231/roles/441d11583e0f484885b1f24b8eeb28dd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:25.612451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072e21f-de16-44a3-9d8e-d5dd31105e5e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:25.622072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41ff13-d489-4ad2-8b32-e7d4f7349179 None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=ba690590103a4019a56b191e8dfe3231, role_id=441d11583e0f484885b1f24b8eeb28dd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:25.622489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:25.623526 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41ff13-d489-4ad2-8b32-e7d4f7349179 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:25.645308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f5591-0f4a-44f6-8cb8-133110deed29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:25.646774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f5591-0f4a-44f6-8cb8-133110deed29 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:25.647113 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f5591-0f4a-44f6-8cb8-133110deed29 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:25.647399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f5591-0f4a-44f6-8cb8-133110deed29 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:25.648278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f5591-0f4a-44f6-8cb8-133110deed29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:25.648597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f5591-0f4a-44f6-8cb8-133110deed29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:25.650008 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f5591-0f4a-44f6-8cb8-133110deed29 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:25.671104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 294/579] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:25.671104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f5591-0f4a-44f6-8cb8-133110deed29 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.721564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 286/580] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:25 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/ba690590103a4019a56b191e8dfe3231/roles/441d11583e0f484885b1f24b8eeb28dd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:25.722416 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41ff13-d489-4ad2-8b32-e7d4f7349179 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.784247 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f5591-0f4a-44f6-8cb8-133110deed29 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:25.823120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de6ba0-0d82-401a-87e5-74da40829f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:25.823929 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de6ba0-0d82-401a-87e5-74da40829f1e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:25.824295 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de6ba0-0d82-401a-87e5-74da40829f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:25.824580 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de6ba0-0d82-401a-87e5-74da40829f1e None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:25.825343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de6ba0-0d82-401a-87e5-74da40829f1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:25.825776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de6ba0-0d82-401a-87e5-74da40829f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:25.827078 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de6ba0-0d82-401a-87e5-74da40829f1e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:25.841893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 295/581] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:25.841893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de6ba0-0d82-401a-87e5-74da40829f1e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.850943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41ff13-d489-4ad2-8b32-e7d4f7349179 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:25.885364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:25.899467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f71de-7db7-49b8-af98-47accac6d836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:25.900321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f71de-7db7-49b8-af98-47accac6d836 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:25.900609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f71de-7db7-49b8-af98-47accac6d836 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:25.900893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f71de-7db7-49b8-af98-47accac6d836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:25.908856 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f71de-7db7-49b8-af98-47accac6d836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:25.910374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f71de-7db7-49b8-af98-47accac6d836 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-4a4f71de-7db7-49b8-af98-47accac6d836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:25.931192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:25.932410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:25.933790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:25.933790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:25.933790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:25.933790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:25.933790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:25.933790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:25.933790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:25.933790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:25.933790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 287/582] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:25.933790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f71de-7db7-49b8-af98-47accac6d836 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:25.937181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:25.973201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de6ba0-0d82-401a-87e5-74da40829f1e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.009925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df778f80-caf5-468c-a1c2-f3dd00f1bcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.010732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778f80-caf5-468c-a1c2-f3dd00f1bcba None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.011017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778f80-caf5-468c-a1c2-f3dd00f1bcba None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.011297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df778f80-caf5-468c-a1c2-f3dd00f1bcba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.022714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df778f80-caf5-468c-a1c2-f3dd00f1bcba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.024217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df778f80-caf5-468c-a1c2-f3dd00f1bcba None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-df778f80-caf5-468c-a1c2-f3dd00f1bcba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:26.043242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:26.044245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:26.045142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:26.045142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:26.045142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:26.045142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:26.045380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f71de-7db7-49b8-af98-47accac6d836 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.045486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 296/583] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:26.045763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df778f80-caf5-468c-a1c2-f3dd00f1bcba None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.084731 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd513a0-a059-4b04-a7db-ba7aeb23ae51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.085541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd513a0-a059-4b04-a7db-ba7aeb23ae51 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.085827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd513a0-a059-4b04-a7db-ba7aeb23ae51 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.086105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd513a0-a059-4b04-a7db-ba7aeb23ae51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.096652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd513a0-a059-4b04-a7db-ba7aeb23ae51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.098222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd513a0-a059-4b04-a7db-ba7aeb23ae51 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-dfd513a0-a059-4b04-a7db-ba7aeb23ae51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:26.120823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:26.121864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:26.122808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:26.122808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:26.122808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:26.122808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:26.122808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 288/584] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:26.123180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd513a0-a059-4b04-a7db-ba7aeb23ae51 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.136134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.156143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df778f80-caf5-468c-a1c2-f3dd00f1bcba None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.191139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.194360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b1dae-c2df-412d-9311-ca58cd37e6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.195165 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b1dae-c2df-412d-9311-ca58cd37e6db None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.195448 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b1dae-c2df-412d-9311-ca58cd37e6db None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.195756 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b1dae-c2df-412d-9311-ca58cd37e6db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.206730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b1dae-c2df-412d-9311-ca58cd37e6db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.208264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b1dae-c2df-412d-9311-ca58cd37e6db None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-fc4b1dae-c2df-412d-9311-ca58cd37e6db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:26.230002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:26.232304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:26.233191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:26.233191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:26.233191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:26.233191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:26.233191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 297/585] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:26.233191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b1dae-c2df-412d-9311-ca58cd37e6db None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.246885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd513a0-a059-4b04-a7db-ba7aeb23ae51 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.293751 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532768f-60da-406f-8ea1-7607dcddae78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.294421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532768f-60da-406f-8ea1-7607dcddae78 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.294708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532768f-60da-406f-8ea1-7607dcddae78 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.294987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532768f-60da-406f-8ea1-7607dcddae78 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.295940 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532768f-60da-406f-8ea1-7607dcddae78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:26.296258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532768f-60da-406f-8ea1-7607dcddae78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.297716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532768f-60da-406f-8ea1-7607dcddae78 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.315635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 289/586] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:26.315635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532768f-60da-406f-8ea1-7607dcddae78 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.350338 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b1dae-c2df-412d-9311-ca58cd37e6db None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.386980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3d8a8-c2ef-47cf-bb40-76724fe1a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.387870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3d8a8-c2ef-47cf-bb40-76724fe1a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.388164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3d8a8-c2ef-47cf-bb40-76724fe1a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.388444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3d8a8-c2ef-47cf-bb40-76724fe1a6a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.389187 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3d8a8-c2ef-47cf-bb40-76724fe1a6a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:26.389501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3d8a8-c2ef-47cf-bb40-76724fe1a6a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.390879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3d8a8-c2ef-47cf-bb40-76724fe1a6a3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.392492 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.408243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 298/587] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:26.408243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3d8a8-c2ef-47cf-bb40-76724fe1a6a3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.429929 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532768f-60da-406f-8ea1-7607dcddae78 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.447758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.467888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2706ea-afa9-4242-94f9-b6a3c1a8306e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.468558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2706ea-afa9-4242-94f9-b6a3c1a8306e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.468850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2706ea-afa9-4242-94f9-b6a3c1a8306e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.469184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2706ea-afa9-4242-94f9-b6a3c1a8306e None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.469915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2706ea-afa9-4242-94f9-b6a3c1a8306e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:26.470502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2706ea-afa9-4242-94f9-b6a3c1a8306e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.472811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2706ea-afa9-4242-94f9-b6a3c1a8306e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.485869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 290/588] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:26.488458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2706ea-afa9-4242-94f9-b6a3c1a8306e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.518247 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3d8a8-c2ef-47cf-bb40-76724fe1a6a3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.556665 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b106d3f-343d-468c-82e8-b958518132f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.557351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b106d3f-343d-468c-82e8-b958518132f4 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.557637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b106d3f-343d-468c-82e8-b958518132f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.557915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b106d3f-343d-468c-82e8-b958518132f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.558647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b106d3f-343d-468c-82e8-b958518132f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:26.558961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b106d3f-343d-468c-82e8-b958518132f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.560372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b106d3f-343d-468c-82e8-b958518132f4 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.572609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 299/589] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:26.573423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b106d3f-343d-468c-82e8-b958518132f4 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.600051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2706ea-afa9-4242-94f9-b6a3c1a8306e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.632073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.636041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7547c2-1aa2-4b25-a7ce-f00f8a791634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.636812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7547c2-1aa2-4b25-a7ce-f00f8a791634 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.637163 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7547c2-1aa2-4b25-a7ce-f00f8a791634 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.637503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7547c2-1aa2-4b25-a7ce-f00f8a791634 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.638390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7547c2-1aa2-4b25-a7ce-f00f8a791634 None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=842ffae8f3b04107b994e57bc880b59b) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:26.638769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7547c2-1aa2-4b25-a7ce-f00f8a791634 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.640351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7547c2-1aa2-4b25-a7ce-f00f8a791634 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.647461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 291/590] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/role_assignments?user.id=842ffae8f3b04107b994e57bc880b59b&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:26.657427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7547c2-1aa2-4b25-a7ce-f00f8a791634 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.684866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b106d3f-343d-468c-82e8-b958518132f4 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.718161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.728432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640d04a-9d8a-45cb-b932-a9152e21027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.729336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640d04a-9d8a-45cb-b932-a9152e21027a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.729675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640d04a-9d8a-45cb-b932-a9152e21027a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.730020 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640d04a-9d8a-45cb-b932-a9152e21027a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.739127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640d04a-9d8a-45cb-b932-a9152e21027a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.740817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640d04a-9d8a-45cb-b932-a9152e21027a None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-e640d04a-9d8a-45cb-b932-a9152e21027a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:26.758415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:26.759653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:26.760801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:26.760801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:26.760801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:26.760801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:26.760801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:26.760801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:26.760801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:26.760801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:26.760801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:26.760801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:26.767603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 300/591] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:26.767603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640d04a-9d8a-45cb-b932-a9152e21027a None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.797384 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7547c2-1aa2-4b25-a7ce-f00f8a791634 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.836705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88fec9-88d4-42df-8bf0-b163d5866d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.837672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88fec9-88d4-42df-8bf0-b163d5866d54 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.838034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88fec9-88d4-42df-8bf0-b163d5866d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.838380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88fec9-88d4-42df-8bf0-b163d5866d54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.846176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88fec9-88d4-42df-8bf0-b163d5866d54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.848386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88fec9-88d4-42df-8bf0-b163d5866d54 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-fe88fec9-88d4-42df-8bf0-b163d5866d54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:26.867908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:26.869015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:26.870114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:26.870114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:26.870114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:26.870114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:26.870114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:26.870114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:26.870114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:26.870114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:26.873777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 292/592] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:26.874643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88fec9-88d4-42df-8bf0-b163d5866d54 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:26.919503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640d04a-9d8a-45cb-b932-a9152e21027a None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:26.937305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.964547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b930d-8d30-4c5d-95b2-5de592a39dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:26.966451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b930d-8d30-4c5d-95b2-5de592a39dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:26.967306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b930d-8d30-4c5d-95b2-5de592a39dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:26.967802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b930d-8d30-4c5d-95b2-5de592a39dd1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:26.978639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b930d-8d30-4c5d-95b2-5de592a39dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:26.980780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b930d-8d30-4c5d-95b2-5de592a39dd1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:26.981369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:26.985170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88fec9-88d4-42df-8bf0-b163d5866d54 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-b28b930d-8d30-4c5d-95b2-5de592a39dd1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:27.001137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:27.003322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:27.005847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:27.005847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:27.005847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:27.005847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:27.005847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:27.005847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:27.005847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:27.005847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:27.005847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:27.005847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:27.007775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 301/593] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:27.011601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b930d-8d30-4c5d-95b2-5de592a39dd1 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.031272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810cea-1a62-4877-90db-af90eb165c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.032158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810cea-1a62-4877-90db-af90eb165c21 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.032468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810cea-1a62-4877-90db-af90eb165c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.033032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810cea-1a62-4877-90db-af90eb165c21 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.033887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c810cea-1a62-4877-90db-af90eb165c21 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:27.034245 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c810cea-1a62-4877-90db-af90eb165c21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.036276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c810cea-1a62-4877-90db-af90eb165c21 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.060913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 293/594] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jun 2 09:54:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:27.061944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810cea-1a62-4877-90db-af90eb165c21 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.153081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b930d-8d30-4c5d-95b2-5de592a39dd1 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.198728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85285cd9-b333-481c-8e01-56d5b533d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.199391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85285cd9-b333-481c-8e01-56d5b533d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.199705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85285cd9-b333-481c-8e01-56d5b533d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.200160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85285cd9-b333-481c-8e01-56d5b533d0e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.200956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85285cd9-b333-481c-8e01-56d5b533d0e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:27.201276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85285cd9-b333-481c-8e01-56d5b533d0e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.202316 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810cea-1a62-4877-90db-af90eb165c21 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.202709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85285cd9-b333-481c-8e01-56d5b533d0e7 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.217184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 302/595] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:27.218134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85285cd9-b333-481c-8e01-56d5b533d0e7 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.249692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cf607-8d8d-4764-929f-4c6204bb2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.250966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cf607-8d8d-4764-929f-4c6204bb2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.251737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cf607-8d8d-4764-929f-4c6204bb2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.252641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cf607-8d8d-4764-929f-4c6204bb2fc8 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.253998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cf607-8d8d-4764-929f-4c6204bb2fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:27.254523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cf607-8d8d-4764-929f-4c6204bb2fc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.255615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:27.258362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62cf607-8d8d-4764-929f-4c6204bb2fc8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.281826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 294/596] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:27.283199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cf607-8d8d-4764-929f-4c6204bb2fc8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.305921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:27.345886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85285cd9-b333-481c-8e01-56d5b533d0e7 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.395598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac1702-3797-465b-a08c-801b99fae00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.397464 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac1702-3797-465b-a08c-801b99fae00a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.397908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac1702-3797-465b-a08c-801b99fae00a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.398339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac1702-3797-465b-a08c-801b99fae00a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.398923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cf607-8d8d-4764-929f-4c6204bb2fc8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.412329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac1702-3797-465b-a08c-801b99fae00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.414143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac1702-3797-465b-a08c-801b99fae00a None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-a6ac1702-3797-465b-a08c-801b99fae00a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:27.433435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:27.434594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:27.435718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:27.435718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:27.435718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:27.435718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:27.437307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 303/597] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:27.438486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac1702-3797-465b-a08c-801b99fae00a None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.448554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6f24-480d-4d15-903a-263bb726a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.448554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6f24-480d-4d15-903a-263bb726a1e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.448554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6f24-480d-4d15-903a-263bb726a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.448554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d6f24-480d-4d15-903a-263bb726a1e5 None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/10d089c711a94b70a198e35443ee7ea5/roles/441d11583e0f484885b1f24b8eeb28dd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.469194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d6f24-480d-4d15-903a-263bb726a1e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=10d089c711a94b70a198e35443ee7ea5, role_id=441d11583e0f484885b1f24b8eeb28dd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.471432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d6f24-480d-4d15-903a-263bb726a1e5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.537910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:27.558523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac1702-3797-465b-a08c-801b99fae00a None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.559870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 295/598] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:27 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/10d089c711a94b70a198e35443ee7ea5/roles/441d11583e0f484885b1f24b8eeb28dd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:27.560795 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6f24-480d-4d15-903a-263bb726a1e5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.607034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e1f99-119d-4f09-9a18-dd954df6813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.608092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e1f99-119d-4f09-9a18-dd954df6813b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.608484 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e1f99-119d-4f09-9a18-dd954df6813b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.608865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e1f99-119d-4f09-9a18-dd954df6813b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.623061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e1f99-119d-4f09-9a18-dd954df6813b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.625504 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e1f99-119d-4f09-9a18-dd954df6813b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-213e1f99-119d-4f09-9a18-dd954df6813b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:27.648689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:27.649900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:27.651386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:27.651386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:27.651386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:27.651386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:27.652967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 304/599] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:27.659697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e1f99-119d-4f09-9a18-dd954df6813b None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.776484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:27.790762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e1f99-119d-4f09-9a18-dd954df6813b None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.836406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8e576-579c-48b9-b137-865e43124d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.841546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8e576-579c-48b9-b137-865e43124d9d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.841546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8e576-579c-48b9-b137-865e43124d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.841546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8e576-579c-48b9-b137-865e43124d9d None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.841546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8e576-579c-48b9-b137-865e43124d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:27.841546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8e576-579c-48b9-b137-865e43124d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.841546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8e576-579c-48b9-b137-865e43124d9d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.852024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:27.866901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 305/600] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:27.869487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8e576-579c-48b9-b137-865e43124d9d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:27.883093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d6f24-480d-4d15-903a-263bb726a1e5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:27.932659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047fab6-35fb-497a-b334-771e5ae1e939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:27.933379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047fab6-35fb-497a-b334-771e5ae1e939 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:27.933659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047fab6-35fb-497a-b334-771e5ae1e939 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:27.933940 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047fab6-35fb-497a-b334-771e5ae1e939 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:27.934680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047fab6-35fb-497a-b334-771e5ae1e939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:27.935044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047fab6-35fb-497a-b334-771e5ae1e939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:27.936498 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047fab6-35fb-497a-b334-771e5ae1e939 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:27.950886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 296/601] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:27.956279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047fab6-35fb-497a-b334-771e5ae1e939 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:28.044473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8e576-579c-48b9-b137-865e43124d9d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.086277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc1875-af44-4d75-9f3e-b69af1b5e56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.087088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc1875-af44-4d75-9f3e-b69af1b5e56d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.087378 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc1875-af44-4d75-9f3e-b69af1b5e56d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.087688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc1875-af44-4d75-9f3e-b69af1b5e56d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.095108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc1875-af44-4d75-9f3e-b69af1b5e56d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:28.096755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc1875-af44-4d75-9f3e-b69af1b5e56d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:28.111672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047fab6-35fb-497a-b334-771e5ae1e939 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-10dc1875-af44-4d75-9f3e-b69af1b5e56d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:28.112041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:28.112912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:28.113809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:28.113809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:28.113809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:28.113809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:28.113809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:28.113809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:28.113809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:28.113809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:28.113809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 306/602] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:28.118193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4783-2670-4d8a-bae8-78d96d928011 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.118193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4783-2670-4d8a-bae8-78d96d928011 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.118193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a4783-2670-4d8a-bae8-78d96d928011 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.118193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 307/603] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:28.118895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4783-2670-4d8a-bae8-78d96d928011 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:28.141283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:28.152649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0630394-13cc-4e76-8772-45fc910c4872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.153532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0630394-13cc-4e76-8772-45fc910c4872 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.153827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0630394-13cc-4e76-8772-45fc910c4872 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.154105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0630394-13cc-4e76-8772-45fc910c4872 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.166435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0630394-13cc-4e76-8772-45fc910c4872 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:28.166435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0630394-13cc-4e76-8772-45fc910c4872 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e0630394-13cc-4e76-8772-45fc910c4872 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:28.178630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:28.179620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:28.180712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:28.180712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:28.180712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:28.180712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:28.180712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:28.180712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:28.180712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:28.180712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:28.183959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 297/604] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:28.185247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67644ab-c7cb-40c7-9a87-fa9c1a05d30e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.185542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67644ab-c7cb-40c7-9a87-fa9c1a05d30e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.185826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67644ab-c7cb-40c7-9a87-fa9c1a05d30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.193283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:28.214014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f67644ab-c7cb-40c7-9a87-fa9c1a05d30e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:28.215535 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f67644ab-c7cb-40c7-9a87-fa9c1a05d30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:28.247785 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a4783-2670-4d8a-bae8-78d96d928011 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.289019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 298/605] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:28.290222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67644ab-c7cb-40c7-9a87-fa9c1a05d30e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:28.299210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a9dc-972a-4268-a9aa-cc134977abfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.300185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a9dc-972a-4268-a9aa-cc134977abfd None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.300665 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a9dc-972a-4268-a9aa-cc134977abfd None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.301119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18a9dc-972a-4268-a9aa-cc134977abfd None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.302866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18a9dc-972a-4268-a9aa-cc134977abfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:28.303426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18a9dc-972a-4268-a9aa-cc134977abfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:28.305065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18a9dc-972a-4268-a9aa-cc134977abfd None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:28.323435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 308/606] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:28.324647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a9dc-972a-4268-a9aa-cc134977abfd None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:28.432434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67644ab-c7cb-40c7-9a87-fa9c1a05d30e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.433340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18a9dc-972a-4268-a9aa-cc134977abfd None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.448566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:28.456661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:28.471324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d5ef-37b6-452b-b83a-513a00d106b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.472331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d5ef-37b6-452b-b83a-513a00d106b7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.472823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d5ef-37b6-452b-b83a-513a00d106b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.473331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d5ef-37b6-452b-b83a-513a00d106b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.474584 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002d5ef-37b6-452b-b83a-513a00d106b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:28.475153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002d5ef-37b6-452b-b83a-513a00d106b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:28.476986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002d5ef-37b6-452b-b83a-513a00d106b7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:28.477457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429c940-d874-47e3-8229-57295ff29075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.478328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429c940-d874-47e3-8229-57295ff29075 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.478680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429c940-d874-47e3-8229-57295ff29075 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.479029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429c940-d874-47e3-8229-57295ff29075 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.492170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 299/607] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:28.493256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d5ef-37b6-452b-b83a-513a00d106b7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:28.501150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429c940-d874-47e3-8229-57295ff29075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-a429c940-d874-47e3-8229-57295ff29075 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:28.509968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:28.510945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:28.511810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:28.515691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 309/608] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:28.516743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429c940-d874-47e3-8229-57295ff29075 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:28.617647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d5ef-37b6-452b-b83a-513a00d106b7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.650702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429c940-d874-47e3-8229-57295ff29075 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.653433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21416f9-1139-4f86-a41f-932172a05da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.654820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21416f9-1139-4f86-a41f-932172a05da2 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.654820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21416f9-1139-4f86-a41f-932172a05da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.655035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21416f9-1139-4f86-a41f-932172a05da2 None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/0faacba133664123b4046de741073bc8/roles/441d11583e0f484885b1f24b8eeb28dd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.672185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21416f9-1139-4f86-a41f-932172a05da2 None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=0faacba133664123b4046de741073bc8, role_id=441d11583e0f484885b1f24b8eeb28dd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:28.673688 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21416f9-1139-4f86-a41f-932172a05da2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:28.696326 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74127d08-a1bd-4c41-8d7c-bf0a798e5a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.697690 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74127d08-a1bd-4c41-8d7c-bf0a798e5a42 None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.698172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74127d08-a1bd-4c41-8d7c-bf0a798e5a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.698646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74127d08-a1bd-4c41-8d7c-bf0a798e5a42 None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/d9263fa2ac534b7b9e5c6658c871da9d/roles/441d11583e0f484885b1f24b8eeb28dd` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.715594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74127d08-a1bd-4c41-8d7c-bf0a798e5a42 None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=d9263fa2ac534b7b9e5c6658c871da9d, role_id=441d11583e0f484885b1f24b8eeb28dd)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:28.717419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74127d08-a1bd-4c41-8d7c-bf0a798e5a42 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:28.781931 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 300/609] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:28 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/0faacba133664123b4046de741073bc8/roles/441d11583e0f484885b1f24b8eeb28dd => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:28.781931 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21416f9-1139-4f86-a41f-932172a05da2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:28.813611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 310/610] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:28 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/d9263fa2ac534b7b9e5c6658c871da9d/roles/441d11583e0f484885b1f24b8eeb28dd => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:28.814714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:28.904580 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21416f9-1139-4f86-a41f-932172a05da2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:28.957292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe1283-5b22-416d-895d-16ffd028c1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:28.959302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe1283-5b22-416d-895d-16ffd028c1df None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:28.959951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe1283-5b22-416d-895d-16ffd028c1df None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:28.960497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe1283-5b22-416d-895d-16ffd028c1df None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:28.961572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe1283-5b22-416d-895d-16ffd028c1df None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:28.962157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe1283-5b22-416d-895d-16ffd028c1df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:28.963945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe1283-5b22-416d-895d-16ffd028c1df None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:28.982317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 301/611] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:28.987956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74127d08-a1bd-4c41-8d7c-bf0a798e5a42 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:29.038661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a39e-6826-4aed-af76-5b5a6100c2f7 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:29.038998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a39e-6826-4aed-af76-5b5a6100c2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:29.039230 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699a39e-6826-4aed-af76-5b5a6100c2f7 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:29.042157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 302/612] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:29.048150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83a5b8-0b65-4f81-ab1a-ff968b18aa08 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:29.048440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83a5b8-0b65-4f81-ab1a-ff968b18aa08 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:29.049988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83a5b8-0b65-4f81-ab1a-ff968b18aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:29.058482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:29.074501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1e83a5b8-0b65-4f81-ab1a-ff968b18aa08 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:29.075762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1e83a5b8-0b65-4f81-ab1a-ff968b18aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:29.160148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 303/613] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:29.169547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74127d08-a1bd-4c41-8d7c-bf0a798e5a42 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:29.184491 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83a5b8-0b65-4f81-ab1a-ff968b18aa08 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:29.204909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:29.209237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b7b56-b846-473e-819e-002209f2a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:29.210038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b7b56-b846-473e-819e-002209f2a1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:29.210324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b7b56-b846-473e-819e-002209f2a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:29.210597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b7b56-b846-473e-819e-002209f2a1b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:29.223195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b7b56-b846-473e-819e-002209f2a1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:29.225541 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b7b56-b846-473e-819e-002209f2a1b7 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-318b7b56-b846-473e-819e-002209f2a1b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:29.245287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:29.246252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:29.247424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:29.247424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:29.247424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:29.247424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:29.247424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 311/614] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:29.252078 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b7b56-b846-473e-819e-002209f2a1b7 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:29.348355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:29.367269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83a5b8-0b65-4f81-ab1a-ff968b18aa08 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:29.370836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b7b56-b846-473e-819e-002209f2a1b7 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:29.409865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca3de6-cbc2-40fe-8981-22dd3d106026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:29.411081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca3de6-cbc2-40fe-8981-22dd3d106026 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:29.411511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca3de6-cbc2-40fe-8981-22dd3d106026 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:29.411948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca3de6-cbc2-40fe-8981-22dd3d106026 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:29.412835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca3de6-cbc2-40fe-8981-22dd3d106026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:29.413287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca3de6-cbc2-40fe-8981-22dd3d106026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:29.414885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca3de6-cbc2-40fe-8981-22dd3d106026 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:29.429600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 312/615] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:29.435738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca3de6-cbc2-40fe-8981-22dd3d106026 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:29.472347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1635-a539-42ea-9b90-10ffc71219d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:29.473154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1635-a539-42ea-9b90-10ffc71219d4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:29.473443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1635-a539-42ea-9b90-10ffc71219d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:29.474443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b1635-a539-42ea-9b90-10ffc71219d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:29.499300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b1635-a539-42ea-9b90-10ffc71219d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-583b1635-a539-42ea-9b90-10ffc71219d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:29.516036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:29.517158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:29.518023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:29.518851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 304/616] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:29.524248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1635-a539-42ea-9b90-10ffc71219d4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:29.557097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca3de6-cbc2-40fe-8981-22dd3d106026 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:29.596421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560ae27-e007-4d1c-9153-e913c0ddccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:29.597763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ae27-e007-4d1c-9153-e913c0ddccd8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:29.598226 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ae27-e007-4d1c-9153-e913c0ddccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:29.599195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560ae27-e007-4d1c-9153-e913c0ddccd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:29.608129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560ae27-e007-4d1c-9153-e913c0ddccd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:29.610530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560ae27-e007-4d1c-9153-e913c0ddccd8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:29.613859 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-b560ae27-e007-4d1c-9153-e913c0ddccd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:29.629302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:29.631021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:29.632171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:29.632171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:29.632171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:29.632171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:29.632171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:29.632171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:29.632171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:29.632171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:29.632171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:29.632171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:29.639176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 313/617] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 2 09:54:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:29.640615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560ae27-e007-4d1c-9153-e913c0ddccd8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:29.716550 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:29.758991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b1635-a539-42ea-9b90-10ffc71219d4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:29.803753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560ae27-e007-4d1c-9153-e913c0ddccd8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:29.816891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f26c66-4e42-43df-bc64-52d3fe08f37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:29.818589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f26c66-4e42-43df-bc64-52d3fe08f37d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:29.819245 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f26c66-4e42-43df-bc64-52d3fe08f37d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:29.819752 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f26c66-4e42-43df-bc64-52d3fe08f37d None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:29.820716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f26c66-4e42-43df-bc64-52d3fe08f37d None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:29.821224 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f26c66-4e42-43df-bc64-52d3fe08f37d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:29.822832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f26c66-4e42-43df-bc64-52d3fe08f37d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:29.849119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 305/618] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:29.849971 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfab05-7bf1-4c53-bbdf-96dd9df41e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:29.850713 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfab05-7bf1-4c53-bbdf-96dd9df41e77 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:29.850999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfab05-7bf1-4c53-bbdf-96dd9df41e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:29.851276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfab05-7bf1-4c53-bbdf-96dd9df41e77 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:29.852153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfab05-7bf1-4c53-bbdf-96dd9df41e77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:29.852467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfab05-7bf1-4c53-bbdf-96dd9df41e77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:29.854668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f26c66-4e42-43df-bc64-52d3fe08f37d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:29.855314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfab05-7bf1-4c53-bbdf-96dd9df41e77 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:29.892815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 314/619] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 2 09:54:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:29.898304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfab05-7bf1-4c53-bbdf-96dd9df41e77 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:29.995126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:30.049017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfab05-7bf1-4c53-bbdf-96dd9df41e77 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.067306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f26c66-4e42-43df-bc64-52d3fe08f37d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.120360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa02af8-9b9f-4a10-9ab1-1f9f75527c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.121023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa02af8-9b9f-4a10-9ab1-1f9f75527c57 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.121310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa02af8-9b9f-4a10-9ab1-1f9f75527c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.121585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa02af8-9b9f-4a10-9ab1-1f9f75527c57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.143054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72c5f-a954-406a-8a76-2fb7894e271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.143876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72c5f-a954-406a-8a76-2fb7894e271c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.144167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72c5f-a954-406a-8a76-2fb7894e271c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.144451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be72c5f-a954-406a-8a76-2fb7894e271c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.157890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:30.166068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be72c5f-a954-406a-8a76-2fb7894e271c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:30.173811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be72c5f-a954-406a-8a76-2fb7894e271c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-7be72c5f-a954-406a-8a76-2fb7894e271c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:30.203601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:30.204562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:30.205465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:30.205465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:30.205465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:30.205465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:30.208585 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 306/620] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:30.213645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72c5f-a954-406a-8a76-2fb7894e271c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.230647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa02af8-9b9f-4a10-9ab1-1f9f75527c57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:30.232168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa02af8-9b9f-4a10-9ab1-1f9f75527c57 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:30.328391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:30.353201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be72c5f-a954-406a-8a76-2fb7894e271c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.375870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 315/621] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:30.377651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2ccbc-a0e5-4c3b-9ac1-0d6077e56f2d None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.378133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2ccbc-a0e5-4c3b-9ac1-0d6077e56f2d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.378581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2ccbc-a0e5-4c3b-9ac1-0d6077e56f2d None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.380950 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 316/622] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:30.381912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2ccbc-a0e5-4c3b-9ac1-0d6077e56f2d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.396975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105db37-06e8-42e5-95f9-dbaae7f99d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.397763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105db37-06e8-42e5-95f9-dbaae7f99d5d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.398103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105db37-06e8-42e5-95f9-dbaae7f99d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.398392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105db37-06e8-42e5-95f9-dbaae7f99d5d None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.399181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105db37-06e8-42e5-95f9-dbaae7f99d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:30.399505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105db37-06e8-42e5-95f9-dbaae7f99d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:30.401170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105db37-06e8-42e5-95f9-dbaae7f99d5d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:30.419570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 307/623] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:30.419570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abcd40-fab3-46e5-aacf-dee864b9a4ca None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.419570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abcd40-fab3-46e5-aacf-dee864b9a4ca None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.419570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abcd40-fab3-46e5-aacf-dee864b9a4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.438244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a4abcd40-fab3-46e5-aacf-dee864b9a4ca None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:30.439444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a4abcd40-fab3-46e5-aacf-dee864b9a4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:30.495289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:30.524444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 308/624] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:30.526167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abcd40-fab3-46e5-aacf-dee864b9a4ca None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.528456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2ccbc-a0e5-4c3b-9ac1-0d6077e56f2d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.571672 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7c19b-2f16-48f2-9c98-119c46bdb50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.572641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c19b-2f16-48f2-9c98-119c46bdb50e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.573749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c19b-2f16-48f2-9c98-119c46bdb50e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.574040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c19b-2f16-48f2-9c98-119c46bdb50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.586688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7c19b-2f16-48f2-9c98-119c46bdb50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:30.588789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7c19b-2f16-48f2-9c98-119c46bdb50e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-c9d7c19b-2f16-48f2-9c98-119c46bdb50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:30.613349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:30.614626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:30.615819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:30.615819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:30.615819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:30.615819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:30.615819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 317/625] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:30.616255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7c19b-2f16-48f2-9c98-119c46bdb50e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.632677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:30.650188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abcd40-fab3-46e5-aacf-dee864b9a4ca None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.697418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3108f-f8f9-4671-b28e-061f47407b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.698221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3108f-f8f9-4671-b28e-061f47407b7d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.698506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3108f-f8f9-4671-b28e-061f47407b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.698785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3108f-f8f9-4671-b28e-061f47407b7d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.708572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3108f-f8f9-4671-b28e-061f47407b7d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:30.710016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3108f-f8f9-4671-b28e-061f47407b7d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-b1a3108f-f8f9-4671-b28e-061f47407b7d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:30.730775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:30.731808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:30.732765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:30.732765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:30.732765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:30.732765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:30.732765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:30.732765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:30.732765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:30.732765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:30.732765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:30.732765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:30.732765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 309/626] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:30.734101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3108f-f8f9-4671-b28e-061f47407b7d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.742341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7c19b-2f16-48f2-9c98-119c46bdb50e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.786635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:30.794537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da88171-af05-42a8-8c76-f8293fe85cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.800163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da88171-af05-42a8-8c76-f8293fe85cae None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.800163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da88171-af05-42a8-8c76-f8293fe85cae None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.800163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da88171-af05-42a8-8c76-f8293fe85cae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.811306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da88171-af05-42a8-8c76-f8293fe85cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-2da88171-af05-42a8-8c76-f8293fe85cae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:30.822804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:30.823969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:30.825018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:30.827864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 318/627] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:30.828801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da88171-af05-42a8-8c76-f8293fe85cae None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.865857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3108f-f8f9-4671-b28e-061f47407b7d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.908649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:30.909851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd2b2-24ec-4b2f-87ee-d2df4dfaf258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.910926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd2b2-24ec-4b2f-87ee-d2df4dfaf258 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.910926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd2b2-24ec-4b2f-87ee-d2df4dfaf258 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.911548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fd2b2-24ec-4b2f-87ee-d2df4dfaf258 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.912623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fd2b2-24ec-4b2f-87ee-d2df4dfaf258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:30.913043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fd2b2-24ec-4b2f-87ee-d2df4dfaf258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:30.914630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fd2b2-24ec-4b2f-87ee-d2df4dfaf258 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:30.932742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 310/628] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:30.932742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd2b2-24ec-4b2f-87ee-d2df4dfaf258 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:30.950546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da88171-af05-42a8-8c76-f8293fe85cae None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:30.987849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4da5a-f5e4-4952-8831-b671a12b1b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:30.988794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4da5a-f5e4-4952-8831-b671a12b1b36 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:30.989989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4da5a-f5e4-4952-8831-b671a12b1b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:30.990500 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4da5a-f5e4-4952-8831-b671a12b1b36 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:30.991523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4da5a-f5e4-4952-8831-b671a12b1b36 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:30.992051 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4da5a-f5e4-4952-8831-b671a12b1b36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:30.993789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f4da5a-f5e4-4952-8831-b671a12b1b36 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.014113 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 319/629] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:31.015346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4da5a-f5e4-4952-8831-b671a12b1b36 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.040751 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.044059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fd2b2-24ec-4b2f-87ee-d2df4dfaf258 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.080486 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e9f9c-38b6-41cc-bede-974c25dcf12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.082179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e9f9c-38b6-41cc-bede-974c25dcf12c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.082579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e9f9c-38b6-41cc-bede-974c25dcf12c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.083120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e9f9c-38b6-41cc-bede-974c25dcf12c None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.084109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e9f9c-38b6-41cc-bede-974c25dcf12c None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:31.084466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e9f9c-38b6-41cc-bede-974c25dcf12c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.085833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e9f9c-38b6-41cc-bede-974c25dcf12c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.100353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 311/630] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:31.101577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e9f9c-38b6-41cc-bede-974c25dcf12c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.127913 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4da5a-f5e4-4952-8831-b671a12b1b36 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.159776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.169402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2999-9f97-4e49-b49f-4e63c65042f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.170617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2999-9f97-4e49-b49f-4e63c65042f3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.171116 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2999-9f97-4e49-b49f-4e63c65042f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.171680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2999-9f97-4e49-b49f-4e63c65042f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.180377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2999-9f97-4e49-b49f-4e63c65042f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.182272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2999-9f97-4e49-b49f-4e63c65042f3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-830a2999-9f97-4e49-b49f-4e63c65042f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:31.199033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:31.200071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:31.201219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:31.201219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:31.201219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:31.201219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:31.201219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:31.201219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:31.201219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:31.201219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:31.209480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 320/631] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:31.210748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2999-9f97-4e49-b49f-4e63c65042f3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.223081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e9f9c-38b6-41cc-bede-974c25dcf12c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.261572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63433fa-0dfb-46ec-823d-680e86fd8d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.262371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63433fa-0dfb-46ec-823d-680e86fd8d45 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.262660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63433fa-0dfb-46ec-823d-680e86fd8d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.262985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63433fa-0dfb-46ec-823d-680e86fd8d45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.275523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63433fa-0dfb-46ec-823d-680e86fd8d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.277278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63433fa-0dfb-46ec-823d-680e86fd8d45 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-c63433fa-0dfb-46ec-823d-680e86fd8d45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:31.302249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:31.303242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:31.304178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:31.304178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:31.304178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:31.304178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:31.304178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 312/632] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:31.304914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63433fa-0dfb-46ec-823d-680e86fd8d45 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.322263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.324631 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2999-9f97-4e49-b49f-4e63c65042f3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.361200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af7fe2-138f-45a7-b0c7-af7dff9a80d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.362388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7fe2-138f-45a7-b0c7-af7dff9a80d6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.362888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7fe2-138f-45a7-b0c7-af7dff9a80d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.363367 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7fe2-138f-45a7-b0c7-af7dff9a80d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.375615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af7fe2-138f-45a7-b0c7-af7dff9a80d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.377361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af7fe2-138f-45a7-b0c7-af7dff9a80d6 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-30af7fe2-138f-45a7-b0c7-af7dff9a80d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:31.396915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:31.397842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:31.398739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:31.398739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:31.398739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:31.398739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:31.401269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 321/633] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:31.402258 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af7fe2-138f-45a7-b0c7-af7dff9a80d6 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.420156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63433fa-0dfb-46ec-823d-680e86fd8d45 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.446973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.457101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb636d41-bf01-45f7-8064-fa7eef7a638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.458336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb636d41-bf01-45f7-8064-fa7eef7a638c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.458710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb636d41-bf01-45f7-8064-fa7eef7a638c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.458995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb636d41-bf01-45f7-8064-fa7eef7a638c None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.459826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb636d41-bf01-45f7-8064-fa7eef7a638c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:31.460198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb636d41-bf01-45f7-8064-fa7eef7a638c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.463181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb636d41-bf01-45f7-8064-fa7eef7a638c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.480404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 313/634] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:31.481343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb636d41-bf01-45f7-8064-fa7eef7a638c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.513103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af7fe2-138f-45a7-b0c7-af7dff9a80d6 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.552506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a4239-844f-4264-9211-92f2aa21cf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.553168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a4239-844f-4264-9211-92f2aa21cf61 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.553445 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a4239-844f-4264-9211-92f2aa21cf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.553724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a4239-844f-4264-9211-92f2aa21cf61 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.554447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a4239-844f-4264-9211-92f2aa21cf61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:31.554752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a4239-844f-4264-9211-92f2aa21cf61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.556147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a4239-844f-4264-9211-92f2aa21cf61 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.559203 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.568311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 322/635] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:31.569053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a4239-844f-4264-9211-92f2aa21cf61 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.585219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb636d41-bf01-45f7-8064-fa7eef7a638c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.621896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e416d9-154c-48fd-94af-234e36953390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.622647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e416d9-154c-48fd-94af-234e36953390 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.622994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e416d9-154c-48fd-94af-234e36953390 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.623287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e416d9-154c-48fd-94af-234e36953390 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.624054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e416d9-154c-48fd-94af-234e36953390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:31.624371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e416d9-154c-48fd-94af-234e36953390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.625736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e416d9-154c-48fd-94af-234e36953390 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.637285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 314/636] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:31.638500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8d417-8d8d-4579-8761-c0a844902009 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.638790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8d417-8d8d-4579-8761-c0a844902009 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.639066 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8d417-8d8d-4579-8761-c0a844902009 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.640506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 315/637] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:31.644813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1415-e566-405a-bdcd-c88b0b31b367 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.645103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1415-e566-405a-bdcd-c88b0b31b367 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.645430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e1415-e566-405a-bdcd-c88b0b31b367 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.646684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 316/638] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:31.647463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e1415-e566-405a-bdcd-c88b0b31b367 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.664442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.667526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a4239-844f-4264-9211-92f2aa21cf61 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.702146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e571f9-c885-4838-9fbf-f5941b3f2eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.702797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e571f9-c885-4838-9fbf-f5941b3f2eef None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.703078 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e571f9-c885-4838-9fbf-f5941b3f2eef None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.703351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e571f9-c885-4838-9fbf-f5941b3f2eef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.704204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e571f9-c885-4838-9fbf-f5941b3f2eef None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=ba690590103a4019a56b191e8dfe3231) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:31.704513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e571f9-c885-4838-9fbf-f5941b3f2eef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.705925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e571f9-c885-4838-9fbf-f5941b3f2eef None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.711830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 323/639] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/role_assignments?user.id=ba690590103a4019a56b191e8dfe3231&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:31.712371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e571f9-c885-4838-9fbf-f5941b3f2eef None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:31.764790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e1415-e566-405a-bdcd-c88b0b31b367 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.805181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f235694-3c58-44f2-95f4-34cb43ba25df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.805996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235694-3c58-44f2-95f4-34cb43ba25df None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.806287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235694-3c58-44f2-95f4-34cb43ba25df None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.806568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235694-3c58-44f2-95f4-34cb43ba25df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.808861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.814519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f235694-3c58-44f2-95f4-34cb43ba25df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.816143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f235694-3c58-44f2-95f4-34cb43ba25df None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.825651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e571f9-c885-4838-9fbf-f5941b3f2eef None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-7f235694-3c58-44f2-95f4-34cb43ba25df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:31.833422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:31.834379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:31.835283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:31.835283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:31.835283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:31.835283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:31.835283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:31.835283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:31.835283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:31.835283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:31.835283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 317/640] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:31.836378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e50a-9f69-4529-95f3-7b611846af18 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.836378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e50a-9f69-4529-95f3-7b611846af18 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.836590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e50a-9f69-4529-95f3-7b611846af18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.856097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9557e50a-9f69-4529-95f3-7b611846af18 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:31.857330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9557e50a-9f69-4529-95f3-7b611846af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:31.871021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f827792-024d-4f17-9412-7cacd579296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:31.871872 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f827792-024d-4f17-9412-7cacd579296e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.872159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f827792-024d-4f17-9412-7cacd579296e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.872438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f827792-024d-4f17-9412-7cacd579296e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.882867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f827792-024d-4f17-9412-7cacd579296e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:31.884710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f827792-024d-4f17-9412-7cacd579296e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-4f827792-024d-4f17-9412-7cacd579296e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:31.901312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:31.902564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:31.903532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:31.903532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:31.903532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:31.903532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:31.903532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:31.903532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:31.903532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:31.903532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:31.903532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 09:54:31.903532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:31.903532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 324/641] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:31.907145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9f737-90d3-4609-be0c-be132a8ebfd6 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:31.907145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9f737-90d3-4609-be0c-be132a8ebfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:31.907145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9f737-90d3-4609-be0c-be132a8ebfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:31.925079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-6fa9f737-90d3-4609-be0c-be132a8ebfd6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:31.926278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6fa9f737-90d3-4609-be0c-be132a8ebfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:31.946414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:31.952859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 318/642] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:31.953739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557e50a-9f69-4529-95f3-7b611846af18 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.005344 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 325/643] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:32.006755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9f737-90d3-4609-be0c-be132a8ebfd6 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.071268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557e50a-9f69-4529-95f3-7b611846af18 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.099368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.110389 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25976fb3-7b43-4202-a223-90c49af5ccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.111062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25976fb3-7b43-4202-a223-90c49af5ccb7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.111348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25976fb3-7b43-4202-a223-90c49af5ccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.111913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25976fb3-7b43-4202-a223-90c49af5ccb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.112522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25976fb3-7b43-4202-a223-90c49af5ccb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:32.112834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25976fb3-7b43-4202-a223-90c49af5ccb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.114432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25976fb3-7b43-4202-a223-90c49af5ccb7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.125132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9f737-90d3-4609-be0c-be132a8ebfd6 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.130915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 319/644] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:32.130915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25976fb3-7b43-4202-a223-90c49af5ccb7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.168177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e60a8-3bba-4a81-9438-2c5f179ee5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.168925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e60a8-3bba-4a81-9438-2c5f179ee5cd None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.169836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e60a8-3bba-4a81-9438-2c5f179ee5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.169836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e60a8-3bba-4a81-9438-2c5f179ee5cd None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.170467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e60a8-3bba-4a81-9438-2c5f179ee5cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:32.170849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e60a8-3bba-4a81-9438-2c5f179ee5cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.172392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e60a8-3bba-4a81-9438-2c5f179ee5cd None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.190627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 326/645] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:32.191450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e60a8-3bba-4a81-9438-2c5f179ee5cd None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.210612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.249207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25976fb3-7b43-4202-a223-90c49af5ccb7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.293341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406ed97-33d4-485e-949b-8fe8ae16e2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.294145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406ed97-33d4-485e-949b-8fe8ae16e2ee None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.294426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406ed97-33d4-485e-949b-8fe8ae16e2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.294691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406ed97-33d4-485e-949b-8fe8ae16e2ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.307114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e60a8-3bba-4a81-9438-2c5f179ee5cd None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.307959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406ed97-33d4-485e-949b-8fe8ae16e2ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-3406ed97-33d4-485e-949b-8fe8ae16e2ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:32.315822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:32.316780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 320/646] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:32.318421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406ed97-33d4-485e-949b-8fe8ae16e2ee None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.351121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c827f1e-7725-4b33-a856-fa6df03d0b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.352036 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c827f1e-7725-4b33-a856-fa6df03d0b3a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.352238 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c827f1e-7725-4b33-a856-fa6df03d0b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.352516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c827f1e-7725-4b33-a856-fa6df03d0b3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.362871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c827f1e-7725-4b33-a856-fa6df03d0b3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-3c827f1e-7725-4b33-a856-fa6df03d0b3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:32.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:32.372096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 327/647] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:32.372948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c827f1e-7725-4b33-a856-fa6df03d0b3a None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.379367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.439621 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406ed97-33d4-485e-949b-8fe8ae16e2ee None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.447825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.475248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe976ee7-5d2a-4b87-a524-ececc5db37b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.476169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976ee7-5d2a-4b87-a524-ececc5db37b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.476690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976ee7-5d2a-4b87-a524-ececc5db37b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.476690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe976ee7-5d2a-4b87-a524-ececc5db37b0 None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/842ffae8f3b04107b994e57bc880b59b/roles/441d11583e0f484885b1f24b8eeb28dd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.479623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c827f1e-7725-4b33-a856-fa6df03d0b3a None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.491624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe976ee7-5d2a-4b87-a524-ececc5db37b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=842ffae8f3b04107b994e57bc880b59b, role_id=441d11583e0f484885b1f24b8eeb28dd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.493074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe976ee7-5d2a-4b87-a524-ececc5db37b0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.514570 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b92294-2e9c-435f-91cb-19871471f2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.515225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b92294-2e9c-435f-91cb-19871471f2fc None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.515513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b92294-2e9c-435f-91cb-19871471f2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.515826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b92294-2e9c-435f-91cb-19871471f2fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.565129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 321/648] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:32 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/842ffae8f3b04107b994e57bc880b59b/roles/441d11583e0f484885b1f24b8eeb28dd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:32.566563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe976ee7-5d2a-4b87-a524-ececc5db37b0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.608734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b92294-2e9c-435f-91cb-19871471f2fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.610854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b92294-2e9c-435f-91cb-19871471f2fc None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.690598 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.702319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe976ee7-5d2a-4b87-a524-ececc5db37b0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.704950 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:32.748048 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 328/649] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:32.749940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b92294-2e9c-435f-91cb-19871471f2fc None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.757417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26db7be-554c-45ff-ac21-34bcb2d7f4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.758105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db7be-554c-45ff-ac21-34bcb2d7f4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.758388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db7be-554c-45ff-ac21-34bcb2d7f4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.758665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26db7be-554c-45ff-ac21-34bcb2d7f4e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.760505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26db7be-554c-45ff-ac21-34bcb2d7f4e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:32.760505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26db7be-554c-45ff-ac21-34bcb2d7f4e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.761343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26db7be-554c-45ff-ac21-34bcb2d7f4e9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.770461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 322/650] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:32.771338 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26db7be-554c-45ff-ac21-34bcb2d7f4e9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.885425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26db7be-554c-45ff-ac21-34bcb2d7f4e9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.897710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b92294-2e9c-435f-91cb-19871471f2fc None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:32.920766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aed2bf-861c-4ad0-8d27-3e77dd6ff3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.921582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aed2bf-861c-4ad0-8d27-3e77dd6ff3ef None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.921866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aed2bf-861c-4ad0-8d27-3e77dd6ff3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.922143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aed2bf-861c-4ad0-8d27-3e77dd6ff3ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.935472 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aed2bf-861c-4ad0-8d27-3e77dd6ff3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.936985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aed2bf-861c-4ad0-8d27-3e77dd6ff3ef None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.945699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5d436-fd7e-4f0f-916b-d266dd40116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:32.946930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5d436-fd7e-4f0f-916b-d266dd40116c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:32.947317 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5d436-fd7e-4f0f-916b-d266dd40116c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:32.947980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5d436-fd7e-4f0f-916b-d266dd40116c None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:32.948842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5d436-fd7e-4f0f-916b-d266dd40116c None admin] RBAC: Adding query filter params (name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:32.949253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5d436-fd7e-4f0f-916b-d266dd40116c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:32.950712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5d436-fd7e-4f0f-916b-d266dd40116c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-d7aed2bf-861c-4ad0-8d27-3e77dd6ff3ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:32.955834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:32.956898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:32.958041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:32.958041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:32.958041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:32.958041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:32.958041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 323/651] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:32.958332 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aed2bf-861c-4ad0-8d27-3e77dd6ff3ef None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.961908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 329/652] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:32.968865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5d436-fd7e-4f0f-916b-d266dd40116c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:32.976798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.018725 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.077189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aed2bf-861c-4ad0-8d27-3e77dd6ff3ef None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.116777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5d436-fd7e-4f0f-916b-d266dd40116c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.125360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67b93-d266-4bda-8ac9-d4e2ced6b511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.126792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67b93-d266-4bda-8ac9-d4e2ced6b511 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.127251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67b93-d266-4bda-8ac9-d4e2ced6b511 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.127531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d67b93-d266-4bda-8ac9-d4e2ced6b511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.142766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67b93-d266-4bda-8ac9-d4e2ced6b511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.144781 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d67b93-d266-4bda-8ac9-d4e2ced6b511 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.153956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1173f0-9989-4815-9401-20cdc749f8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.154857 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1173f0-9989-4815-9401-20cdc749f8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.155203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1173f0-9989-4815-9401-20cdc749f8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.155546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1173f0-9989-4815-9401-20cdc749f8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.166719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1173f0-9989-4815-9401-20cdc749f8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-50d67b93-d266-4bda-8ac9-d4e2ced6b511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:33.166928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:33.167841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:33.168728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:33.168728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:33.168728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:33.168728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:33.169034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1173f0-9989-4815-9401-20cdc749f8d6 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.169105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 324/653] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:33.169407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67b93-d266-4bda-8ac9-d4e2ced6b511 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-ef1173f0-9989-4815-9401-20cdc749f8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:33.187309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:33.189145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:33.191219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:33.191219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:33.191219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:33.191219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:33.191219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 330/654] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:33.191219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1173f0-9989-4815-9401-20cdc749f8d6 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.238012 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.281060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d67b93-d266-4bda-8ac9-d4e2ced6b511 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.291145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.307919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1173f0-9989-4815-9401-20cdc749f8d6 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.316617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3d70e-b183-42ed-b401-886178dc50a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.318015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3d70e-b183-42ed-b401-886178dc50a1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.318307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3d70e-b183-42ed-b401-886178dc50a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.318852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3d70e-b183-42ed-b401-886178dc50a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.319304 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3d70e-b183-42ed-b401-886178dc50a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:33.319633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3d70e-b183-42ed-b401-886178dc50a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.321490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3d70e-b183-42ed-b401-886178dc50a1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.334743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 325/655] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:33.335617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3d70e-b183-42ed-b401-886178dc50a1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.347414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd3a26-26eb-4aeb-98e7-f28e368a40f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.348825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd3a26-26eb-4aeb-98e7-f28e368a40f1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.349263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd3a26-26eb-4aeb-98e7-f28e368a40f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.349686 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd3a26-26eb-4aeb-98e7-f28e368a40f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.350557 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd3a26-26eb-4aeb-98e7-f28e368a40f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:33.351036 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd3a26-26eb-4aeb-98e7-f28e368a40f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.352592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd3a26-26eb-4aeb-98e7-f28e368a40f1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.365776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 331/656] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:33.367003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd3a26-26eb-4aeb-98e7-f28e368a40f1 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.439667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3d70e-b183-42ed-b401-886178dc50a1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.464065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.474567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd3a26-26eb-4aeb-98e7-f28e368a40f1 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.476693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0addd9-ad17-4674-b02d-31fa1fee47d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.478001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0addd9-ad17-4674-b02d-31fa1fee47d5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.478001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0addd9-ad17-4674-b02d-31fa1fee47d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.478371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0addd9-ad17-4674-b02d-31fa1fee47d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.479195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0addd9-ad17-4674-b02d-31fa1fee47d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:33.479618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0addd9-ad17-4674-b02d-31fa1fee47d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.481098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0addd9-ad17-4674-b02d-31fa1fee47d5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.494802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 326/657] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:33.495685 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0addd9-ad17-4674-b02d-31fa1fee47d5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.512660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8454ff-2336-4ae0-b480-dbbd8c7771e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.513726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8454ff-2336-4ae0-b480-dbbd8c7771e8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.514250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8454ff-2336-4ae0-b480-dbbd8c7771e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.514732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8454ff-2336-4ae0-b480-dbbd8c7771e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.522080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8454ff-2336-4ae0-b480-dbbd8c7771e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.523753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8454ff-2336-4ae0-b480-dbbd8c7771e8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-7a8454ff-2336-4ae0-b480-dbbd8c7771e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:33.538994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:33.540034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:33.540931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:33.540931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:33.540931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:33.540931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:33.540931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:33.540931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:33.540931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:33.540931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:33.543184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 332/658] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:33.544205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8454ff-2336-4ae0-b480-dbbd8c7771e8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.554834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.606546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0addd9-ad17-4674-b02d-31fa1fee47d5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.643786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5036f-f6d8-491f-bb5f-7e9c3045b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.644832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5036f-f6d8-491f-bb5f-7e9c3045b4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.645787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5036f-f6d8-491f-bb5f-7e9c3045b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.646253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5036f-f6d8-491f-bb5f-7e9c3045b4d7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.650203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8454ff-2336-4ae0-b480-dbbd8c7771e8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.655760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5036f-f6d8-491f-bb5f-7e9c3045b4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.657566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5036f-f6d8-491f-bb5f-7e9c3045b4d7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-99a5036f-f6d8-491f-bb5f-7e9c3045b4d7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:33.673619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:33.674681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:33.675671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:33.675671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:33.675671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:33.675671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:33.675671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:33.675671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:33.675671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:33.675671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:33.675671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 09:54:33.675671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:33.678957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 327/659] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:33.680022 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5036f-f6d8-491f-bb5f-7e9c3045b4d7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.687526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06be17-59e0-4548-9035-3903fc8bbd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.688402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be17-59e0-4548-9035-3903fc8bbd54 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.688691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be17-59e0-4548-9035-3903fc8bbd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.689060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06be17-59e0-4548-9035-3903fc8bbd54 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.698120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06be17-59e0-4548-9035-3903fc8bbd54 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.699574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06be17-59e0-4548-9035-3903fc8bbd54 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-4e06be17-59e0-4548-9035-3903fc8bbd54 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:33.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:33.716038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:33.717005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:33.717005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:33.717005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:33.717005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:33.717005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:33.717005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:33.717005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:33.717005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:33.717005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:54:33.717005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:33.717005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 333/660] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:33.717633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06be17-59e0-4548-9035-3903fc8bbd54 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.730584 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.799645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.803320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5036f-f6d8-491f-bb5f-7e9c3045b4d7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.841578 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f7c1f-20b2-4ace-ad9b-4a6a169f1299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.842241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f7c1f-20b2-4ace-ad9b-4a6a169f1299 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.842525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f7c1f-20b2-4ace-ad9b-4a6a169f1299 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.842802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f7c1f-20b2-4ace-ad9b-4a6a169f1299 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.843611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f7c1f-20b2-4ace-ad9b-4a6a169f1299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:33.843953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f7c1f-20b2-4ace-ad9b-4a6a169f1299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.845442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f7c1f-20b2-4ace-ad9b-4a6a169f1299 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.846702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06be17-59e0-4548-9035-3903fc8bbd54 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:33.863185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 328/661] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:33.863185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f7c1f-20b2-4ace-ad9b-4a6a169f1299 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.907082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eaaac-eda8-4107-9068-8d094b59814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:33.908157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eaaac-eda8-4107-9068-8d094b59814b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:33.908616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eaaac-eda8-4107-9068-8d094b59814b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:33.909047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eaaac-eda8-4107-9068-8d094b59814b None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:33.910204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2eaaac-eda8-4107-9068-8d094b59814b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:33.910719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2eaaac-eda8-4107-9068-8d094b59814b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:33.913303 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2eaaac-eda8-4107-9068-8d094b59814b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:33.938032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 334/662] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:33.939277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eaaac-eda8-4107-9068-8d094b59814b None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:33.968779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:33.972101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f7c1f-20b2-4ace-ad9b-4a6a169f1299 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.009414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf7960-0b35-4ce5-865e-45b76a4a9b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.010244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf7960-0b35-4ce5-865e-45b76a4a9b19 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.010629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf7960-0b35-4ce5-865e-45b76a4a9b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.011009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf7960-0b35-4ce5-865e-45b76a4a9b19 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.012012 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf7960-0b35-4ce5-865e-45b76a4a9b19 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:34.012424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf7960-0b35-4ce5-865e-45b76a4a9b19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.013949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf7960-0b35-4ce5-865e-45b76a4a9b19 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.037098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 329/663] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:34.037098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf7960-0b35-4ce5-865e-45b76a4a9b19 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.063573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eaaac-eda8-4107-9068-8d094b59814b None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.091894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.104437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955e6b1-97a5-4150-9834-26c1503bde2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.105564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955e6b1-97a5-4150-9834-26c1503bde2e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.106078 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955e6b1-97a5-4150-9834-26c1503bde2e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.106667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955e6b1-97a5-4150-9834-26c1503bde2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.107815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955e6b1-97a5-4150-9834-26c1503bde2e None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=10d089c711a94b70a198e35443ee7ea5) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:34.108390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955e6b1-97a5-4150-9834-26c1503bde2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.110175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955e6b1-97a5-4150-9834-26c1503bde2e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.124016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 335/664] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:33 2022] GET /identity/v3/role_assignments?user.id=10d089c711a94b70a198e35443ee7ea5&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:34.125989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955e6b1-97a5-4150-9834-26c1503bde2e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.141430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf7960-0b35-4ce5-865e-45b76a4a9b19 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.187625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b73c82-d7bf-4be2-acf3-7bc07bc32889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.188303 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73c82-d7bf-4be2-acf3-7bc07bc32889 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.188588 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73c82-d7bf-4be2-acf3-7bc07bc32889 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.188864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b73c82-d7bf-4be2-acf3-7bc07bc32889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.232986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.269574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955e6b1-97a5-4150-9834-26c1503bde2e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.298911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b73c82-d7bf-4be2-acf3-7bc07bc32889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.301367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b73c82-d7bf-4be2-acf3-7bc07bc32889 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.308964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52bb67-9a7f-4040-b1ff-2a4f19a2a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.309851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52bb67-9a7f-4040-b1ff-2a4f19a2a28d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.310230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52bb67-9a7f-4040-b1ff-2a4f19a2a28d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.310600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52bb67-9a7f-4040-b1ff-2a4f19a2a28d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.384033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.406179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52bb67-9a7f-4040-b1ff-2a4f19a2a28d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.407803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52bb67-9a7f-4040-b1ff-2a4f19a2a28d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.440601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 330/665] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:34.442968 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b763322-0627-4a90-bbca-d9d37a628f52 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.443358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b763322-0627-4a90-bbca-d9d37a628f52 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.443957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b763322-0627-4a90-bbca-d9d37a628f52 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.445699 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 331/666] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:34.452331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae18e05-070d-447e-882e-9039decd6715 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.452331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae18e05-070d-447e-882e-9039decd6715 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.453416 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae18e05-070d-447e-882e-9039decd6715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.472913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8ae18e05-070d-447e-882e-9039decd6715 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:34.474240 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8ae18e05-070d-447e-882e-9039decd6715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:34.537329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.542412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 336/667] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:34.543340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52bb67-9a7f-4040-b1ff-2a4f19a2a28d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.559455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 332/668] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:34.564264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae18e05-070d-447e-882e-9039decd6715 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.665269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.678019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52bb67-9a7f-4040-b1ff-2a4f19a2a28d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.719336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae18e05-070d-447e-882e-9039decd6715 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.724497 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2674b1-9b6b-4d8d-860a-0214cfaefb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.725506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2674b1-9b6b-4d8d-860a-0214cfaefb69 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.725800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2674b1-9b6b-4d8d-860a-0214cfaefb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.726082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2674b1-9b6b-4d8d-860a-0214cfaefb69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.737357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2674b1-9b6b-4d8d-860a-0214cfaefb69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.739362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2674b1-9b6b-4d8d-860a-0214cfaefb69 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-4c2674b1-9b6b-4d8d-860a-0214cfaefb69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:34.758398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:34.759379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:34.760311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:34.760311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:34.760311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:34.760311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:34.760311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 337/669] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:34.760311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2674b1-9b6b-4d8d-860a-0214cfaefb69 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.776826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb501181-5522-468f-8cae-26e465eb4843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.777930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb501181-5522-468f-8cae-26e465eb4843 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.778845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb501181-5522-468f-8cae-26e465eb4843 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.779278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb501181-5522-468f-8cae-26e465eb4843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.794831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb501181-5522-468f-8cae-26e465eb4843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:34.797288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb501181-5522-468f-8cae-26e465eb4843 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-bb501181-5522-468f-8cae-26e465eb4843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:34.818445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:34.819604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:34.820738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:34.820738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:34.820738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:34.820738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:34.826838 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 333/670] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:34.827870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb501181-5522-468f-8cae-26e465eb4843 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.882905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.898129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2674b1-9b6b-4d8d-860a-0214cfaefb69 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:34.936520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569277b-1c1d-49c4-becb-f505c103be79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:34.937712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569277b-1c1d-49c4-becb-f505c103be79 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:34.938149 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569277b-1c1d-49c4-becb-f505c103be79 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:34.938431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569277b-1c1d-49c4-becb-f505c103be79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:34.947836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:34.950811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569277b-1c1d-49c4-becb-f505c103be79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-c569277b-1c1d-49c4-becb-f505c103be79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:34.958998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:34.960001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:34.960888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 338/671] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:34.961580 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569277b-1c1d-49c4-becb-f505c103be79 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:34.964091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb501181-5522-468f-8cae-26e465eb4843 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.003313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f2016-1c50-4051-85ca-3f5bff55ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.004150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2016-1c50-4051-85ca-3f5bff55ca82 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.004973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2016-1c50-4051-85ca-3f5bff55ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.005256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f2016-1c50-4051-85ca-3f5bff55ca82 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.006140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f2016-1c50-4051-85ca-3f5bff55ca82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:35.006448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f2016-1c50-4051-85ca-3f5bff55ca82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.007845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f2016-1c50-4051-85ca-3f5bff55ca82 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.019878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 334/672] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:35.022040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c2f6-e867-4a4e-9e3f-2bc1926d36e6 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.022323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c2f6-e867-4a4e-9e3f-2bc1926d36e6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.022597 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c2f6-e867-4a4e-9e3f-2bc1926d36e6 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.024028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 335/673] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:35.029171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c2f6-e867-4a4e-9e3f-2bc1926d36e6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.079818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569277b-1c1d-49c4-becb-f505c103be79 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.116842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78beb58-cab3-41df-b4e1-009fc63ac671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.117611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78beb58-cab3-41df-b4e1-009fc63ac671 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.117955 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78beb58-cab3-41df-b4e1-009fc63ac671 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.118298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78beb58-cab3-41df-b4e1-009fc63ac671 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.119085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78beb58-cab3-41df-b4e1-009fc63ac671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:35.119463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78beb58-cab3-41df-b4e1-009fc63ac671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.120950 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78beb58-cab3-41df-b4e1-009fc63ac671 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.133606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 339/674] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:35.134405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78beb58-cab3-41df-b4e1-009fc63ac671 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.141163 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.146104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c2f6-e867-4a4e-9e3f-2bc1926d36e6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.185230 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079095c5-ea8b-4155-a271-eebb70dacd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.185898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079095c5-ea8b-4155-a271-eebb70dacd05 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.186185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079095c5-ea8b-4155-a271-eebb70dacd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.186464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079095c5-ea8b-4155-a271-eebb70dacd05 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.187268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079095c5-ea8b-4155-a271-eebb70dacd05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:35.187528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079095c5-ea8b-4155-a271-eebb70dacd05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.188930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079095c5-ea8b-4155-a271-eebb70dacd05 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.197844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.202523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 336/675] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:35.202523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a364-0078-487a-a879-4b18eeff3359 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.202523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a364-0078-487a-a879-4b18eeff3359 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.202523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a364-0078-487a-a879-4b18eeff3359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.217755 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7453a364-0078-487a-a879-4b18eeff3359 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:35.218946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7453a364-0078-487a-a879-4b18eeff3359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:35.243667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78beb58-cab3-41df-b4e1-009fc63ac671 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.279447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5325f6-9079-4a69-8226-9df80bf07002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.280279 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5325f6-9079-4a69-8226-9df80bf07002 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.280561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5325f6-9079-4a69-8226-9df80bf07002 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.280846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5325f6-9079-4a69-8226-9df80bf07002 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.287941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5325f6-9079-4a69-8226-9df80bf07002 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.289384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5325f6-9079-4a69-8226-9df80bf07002 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.295886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 337/676] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:35.295886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453a364-0078-487a-a879-4b18eeff3359 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-5f5325f6-9079-4a69-8226-9df80bf07002 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:35.308142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:35.309065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:35.309983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:35.309983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:35.309983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:35.309983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:35.309983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:35.309983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:35.309983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:35.309983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:35.315365 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 340/677] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:35.315365 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5325f6-9079-4a69-8226-9df80bf07002 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.403194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.412729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453a364-0078-487a-a879-4b18eeff3359 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.433399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5325f6-9079-4a69-8226-9df80bf07002 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.451419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43bfd1-668d-4760-89bb-63cc6df4ab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.452451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43bfd1-668d-4760-89bb-63cc6df4ab76 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.452914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43bfd1-668d-4760-89bb-63cc6df4ab76 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.453359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43bfd1-668d-4760-89bb-63cc6df4ab76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.454041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.462817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43bfd1-668d-4760-89bb-63cc6df4ab76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.467306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43bfd1-668d-4760-89bb-63cc6df4ab76 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.470585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f96d3-4199-4df8-8fa4-554e04a66ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.471385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f96d3-4199-4df8-8fa4-554e04a66ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.471699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f96d3-4199-4df8-8fa4-554e04a66ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.471981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f96d3-4199-4df8-8fa4-554e04a66ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.483236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f96d3-4199-4df8-8fa4-554e04a66ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-9d43bfd1-668d-4760-89bb-63cc6df4ab76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:35.483919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:35.484979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:35.486054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:35.486054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:35.486054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:35.486054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:35.486054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:35.486054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:35.486054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:35.486054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:35.486596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f96d3-4199-4df8-8fa4-554e04a66ad4 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.492979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 338/678] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:35.494096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43bfd1-668d-4760-89bb-63cc6df4ab76 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-d02f96d3-4199-4df8-8fa4-554e04a66ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:35.503185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:35.504234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:35.505155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:35.505155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:35.505155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:35.505155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:35.510056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 341/679] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:35.510056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f96d3-4199-4df8-8fa4-554e04a66ad4 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.604671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43bfd1-668d-4760-89bb-63cc6df4ab76 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.617184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f96d3-4199-4df8-8fa4-554e04a66ad4 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.639461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21e678-89cf-41f2-91aa-976426581b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.640151 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21e678-89cf-41f2-91aa-976426581b15 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.640434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21e678-89cf-41f2-91aa-976426581b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.640714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21e678-89cf-41f2-91aa-976426581b15 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.641500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21e678-89cf-41f2-91aa-976426581b15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:35.641813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21e678-89cf-41f2-91aa-976426581b15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.643251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21e678-89cf-41f2-91aa-976426581b15 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.652331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697d7ae-8f68-42ed-a4e3-6df9ff422d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.653136 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697d7ae-8f68-42ed-a4e3-6df9ff422d60 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.653424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697d7ae-8f68-42ed-a4e3-6df9ff422d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.653706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697d7ae-8f68-42ed-a4e3-6df9ff422d60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.661147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 339/680] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:35.661147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21e678-89cf-41f2-91aa-976426581b15 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.669873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697d7ae-8f68-42ed-a4e3-6df9ff422d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:35.673802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-f697d7ae-8f68-42ed-a4e3-6df9ff422d60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:35.678524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:35.679545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 342/681] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:35.687046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697d7ae-8f68-42ed-a4e3-6df9ff422d60 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.716573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.764075 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21e678-89cf-41f2-91aa-976426581b15 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.791160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697d7ae-8f68-42ed-a4e3-6df9ff422d60 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.799962 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa81049-e706-49f4-8297-a64741e1cbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.800630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81049-e706-49f4-8297-a64741e1cbdd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.800918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81049-e706-49f4-8297-a64741e1cbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.801250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81049-e706-49f4-8297-a64741e1cbdd None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.802534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa81049-e706-49f4-8297-a64741e1cbdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:35.802848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa81049-e706-49f4-8297-a64741e1cbdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.804334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa81049-e706-49f4-8297-a64741e1cbdd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.817017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 340/682] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:35.818111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa81049-e706-49f4-8297-a64741e1cbdd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.828105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c315323-12dd-43f4-8a6e-737e7d3d79a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.829003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c315323-12dd-43f4-8a6e-737e7d3d79a5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.829470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c315323-12dd-43f4-8a6e-737e7d3d79a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.829950 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c315323-12dd-43f4-8a6e-737e7d3d79a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.830986 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c315323-12dd-43f4-8a6e-737e7d3d79a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:35.831476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c315323-12dd-43f4-8a6e-737e7d3d79a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.833479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c315323-12dd-43f4-8a6e-737e7d3d79a5 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.846757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 343/683] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:35.847901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c315323-12dd-43f4-8a6e-737e7d3d79a5 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:35.906905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.938474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa81049-e706-49f4-8297-a64741e1cbdd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.952126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:35.961773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c315323-12dd-43f4-8a6e-737e7d3d79a5 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:35.974200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b57865-7abd-4f7a-bf4c-137aa110998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:35.974797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57865-7abd-4f7a-bf4c-137aa110998a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:35.975084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57865-7abd-4f7a-bf4c-137aa110998a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:35.975363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b57865-7abd-4f7a-bf4c-137aa110998a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:35.976237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b57865-7abd-4f7a-bf4c-137aa110998a None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=d9263fa2ac534b7b9e5c6658c871da9d) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:35.976553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b57865-7abd-4f7a-bf4c-137aa110998a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:35.977984 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b57865-7abd-4f7a-bf4c-137aa110998a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:35.983868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 341/684] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/role_assignments?user.id=d9263fa2ac534b7b9e5c6658c871da9d&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:35.984596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b57865-7abd-4f7a-bf4c-137aa110998a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.010441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a4ab8-625f-4738-959c-3a1b35857daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.011794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a4ab8-625f-4738-959c-3a1b35857daa None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.012331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a4ab8-625f-4738-959c-3a1b35857daa None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.012821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a4ab8-625f-4738-959c-3a1b35857daa None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.013884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a4ab8-625f-4738-959c-3a1b35857daa None admin] RBAC: Adding query filter params (name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:36.014457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a4ab8-625f-4738-959c-3a1b35857daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.016508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a4ab8-625f-4738-959c-3a1b35857daa None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.032876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 344/685] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:36.034210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a4ab8-625f-4738-959c-3a1b35857daa None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.103172 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b57865-7abd-4f7a-bf4c-137aa110998a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.142469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7ad21-0eaf-432c-b6e9-9ebe5dc7af54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.143152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7ad21-0eaf-432c-b6e9-9ebe5dc7af54 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.143438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7ad21-0eaf-432c-b6e9-9ebe5dc7af54 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.143751 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7ad21-0eaf-432c-b6e9-9ebe5dc7af54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.145159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7ad21-0eaf-432c-b6e9-9ebe5dc7af54 None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=0faacba133664123b4046de741073bc8) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:36.145159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7ad21-0eaf-432c-b6e9-9ebe5dc7af54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.146547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7ad21-0eaf-432c-b6e9-9ebe5dc7af54 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.150087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.159611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 342/686] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:35 2022] GET /identity/v3/role_assignments?user.id=0faacba133664123b4046de741073bc8&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:36.159611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7ad21-0eaf-432c-b6e9-9ebe5dc7af54 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.178685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a4ab8-625f-4738-959c-3a1b35857daa None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.269621 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2bfb0-d039-432e-8a68-9d01b1c49ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.270883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2bfb0-d039-432e-8a68-9d01b1c49ceb None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.271163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2bfb0-d039-432e-8a68-9d01b1c49ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.271437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2bfb0-d039-432e-8a68-9d01b1c49ceb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.285844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2bfb0-d039-432e-8a68-9d01b1c49ceb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.288903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2bfb0-d039-432e-8a68-9d01b1c49ceb None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-b3a2bfb0-d039-432e-8a68-9d01b1c49ceb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:36.310843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:36.311914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:36.312893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:36.312893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:36.312893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:36.312893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:36.312893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:36.312893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:36.312893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:36.312893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:36.312893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:36.312893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:36.314517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 345/687] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:36.323311 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7ad21-0eaf-432c-b6e9-9ebe5dc7af54 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.323508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2bfb0-d039-432e-8a68-9d01b1c49ceb None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.347697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.366440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8838c-de3d-44af-995c-29a2152df13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.367477 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8838c-de3d-44af-995c-29a2152df13b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.367799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8838c-de3d-44af-995c-29a2152df13b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.368080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8838c-de3d-44af-995c-29a2152df13b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.382320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8838c-de3d-44af-995c-29a2152df13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.383946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8838c-de3d-44af-995c-29a2152df13b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-8ac8838c-de3d-44af-995c-29a2152df13b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:36.403693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:36.404675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:36.406977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:36.406977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:36.406977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:36.406977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:36.406977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 343/688] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:36.412034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8838c-de3d-44af-995c-29a2152df13b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.485499 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.486498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2bfb0-d039-432e-8a68-9d01b1c49ceb None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.528545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee5972-9208-4621-9de7-5d857c7d933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.529051 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee5972-9208-4621-9de7-5d857c7d933e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.529330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee5972-9208-4621-9de7-5d857c7d933e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.529606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee5972-9208-4621-9de7-5d857c7d933e None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.530441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee5972-9208-4621-9de7-5d857c7d933e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:36.530773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee5972-9208-4621-9de7-5d857c7d933e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.532259 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee5972-9208-4621-9de7-5d857c7d933e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.552585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 346/689] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:36.554724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8838c-de3d-44af-995c-29a2152df13b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.560639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee5972-9208-4621-9de7-5d857c7d933e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.597775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1b394-2f81-4894-8f3f-25828dcc66c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.598731 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1b394-2f81-4894-8f3f-25828dcc66c3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.599021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1b394-2f81-4894-8f3f-25828dcc66c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.599298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1b394-2f81-4894-8f3f-25828dcc66c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.600061 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1b394-2f81-4894-8f3f-25828dcc66c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:36.600372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1b394-2f81-4894-8f3f-25828dcc66c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.601754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1b394-2f81-4894-8f3f-25828dcc66c3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.618399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 344/690] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:36.620538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e89d-76dc-4d0f-9da8-dc947d81bcb7 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.620845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e89d-76dc-4d0f-9da8-dc947d81bcb7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.621128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26e89d-76dc-4d0f-9da8-dc947d81bcb7 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.623698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 345/691] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:36.624644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26e89d-76dc-4d0f-9da8-dc947d81bcb7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.650529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.681655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee5972-9208-4621-9de7-5d857c7d933e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.724879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e5eec-fade-418e-9bac-992a3314c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.727157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e5eec-fade-418e-9bac-992a3314c8aa None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.728072 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e5eec-fade-418e-9bac-992a3314c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.728601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e5eec-fade-418e-9bac-992a3314c8aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.749532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26e89d-76dc-4d0f-9da8-dc947d81bcb7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:36.764257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.787041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8acb3-48f7-4c58-8606-f0c0e10db9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:36.787900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8acb3-48f7-4c58-8606-f0c0e10db9fa None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.788188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8acb3-48f7-4c58-8606-f0c0e10db9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.788470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8acb3-48f7-4c58-8606-f0c0e10db9fa None admin] PATH_INFO: `/v3/users/swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.797147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8acb3-48f7-4c58-8606-f0c0e10db9fa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.798605 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8acb3-48f7-4c58-8606-f0c0e10db9fa None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-11b8acb3-48f7-4c58-8606-f0c0e10db9fa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:36.813899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:36.814865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:36.816370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:36.816370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:36.816370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:36.816370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:36.816370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:36.816370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:36.816370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:36.816370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:36.816370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:36.816370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:36.816370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 346/692] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:36.817054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066aa92-d660-49f5-b7b0-28f4fbde43ba None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:36.817054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066aa92-d660-49f5-b7b0-28f4fbde43ba None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:36.817522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066aa92-d660-49f5-b7b0-28f4fbde43ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:36.827981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e5eec-fade-418e-9bac-992a3314c8aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:36.830217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e5eec-fade-418e-9bac-992a3314c8aa None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:36.835057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5066aa92-d660-49f5-b7b0-28f4fbde43ba None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:36.836257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5066aa92-d660-49f5-b7b0-28f4fbde43ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:36.915766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 347/693] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:36.916655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066aa92-d660-49f5-b7b0-28f4fbde43ba None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:36.947420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:36.982688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 347/694] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:36.983858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e5eec-fade-418e-9bac-992a3314c8aa None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.035018 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066aa92-d660-49f5-b7b0-28f4fbde43ba None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.036631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.072038 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a61b03-7026-4151-aa62-fb083c0b518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.072912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a61b03-7026-4151-aa62-fb083c0b518e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.073035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a61b03-7026-4151-aa62-fb083c0b518e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.073357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a61b03-7026-4151-aa62-fb083c0b518e None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.074609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a61b03-7026-4151-aa62-fb083c0b518e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:37.074995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a61b03-7026-4151-aa62-fb083c0b518e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.076909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a61b03-7026-4151-aa62-fb083c0b518e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.093766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e5eec-fade-418e-9bac-992a3314c8aa None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.095718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 348/695] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:37.097331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a61b03-7026-4151-aa62-fb083c0b518e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.133088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bb1e5-4866-47e9-8427-7ce8cbde4ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.134234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bb1e5-4866-47e9-8427-7ce8cbde4ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.134660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bb1e5-4866-47e9-8427-7ce8cbde4ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.135118 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bb1e5-4866-47e9-8427-7ce8cbde4ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.146885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bb1e5-4866-47e9-8427-7ce8cbde4ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.148562 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bb1e5-4866-47e9-8427-7ce8cbde4ee9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-a60bb1e5-4866-47e9-8427-7ce8cbde4ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:37.168345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:37.169431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:37.170358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:37.170358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:37.170358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:37.170358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:37.177361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 348/696] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:37.178529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bb1e5-4866-47e9-8427-7ce8cbde4ee9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.203616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a61b03-7026-4151-aa62-fb083c0b518e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.206401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.240022 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f24f8-0d23-4959-92ab-045f32529ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.240818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f24f8-0d23-4959-92ab-045f32529ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.241123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f24f8-0d23-4959-92ab-045f32529ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.241395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f24f8-0d23-4959-92ab-045f32529ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.252976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f24f8-0d23-4959-92ab-045f32529ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.254999 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f24f8-0d23-4959-92ab-045f32529ef7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-5b7f24f8-0d23-4959-92ab-045f32529ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:37.272906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:37.273832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:37.274736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:37.274736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:37.274736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:37.274736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:37.274736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 349/697] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:37.275500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f24f8-0d23-4959-92ab-045f32529ef7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.291201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.294072 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bb1e5-4866-47e9-8427-7ce8cbde4ee9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.331102 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5897f5-4a27-4d31-8d92-dac46a9a7748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.332218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5897f5-4a27-4d31-8d92-dac46a9a7748 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.332788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5897f5-4a27-4d31-8d92-dac46a9a7748 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.333560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5897f5-4a27-4d31-8d92-dac46a9a7748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.383155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f24f8-0d23-4959-92ab-045f32529ef7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.419248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbe805-bcdc-4570-98be-4772e2a6a43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.419952 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbe805-bcdc-4570-98be-4772e2a6a43a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.420238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbe805-bcdc-4570-98be-4772e2a6a43a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.420515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbe805-bcdc-4570-98be-4772e2a6a43a None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.421306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbe805-bcdc-4570-98be-4772e2a6a43a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:37.421617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbe805-bcdc-4570-98be-4772e2a6a43a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.423036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbe805-bcdc-4570-98be-4772e2a6a43a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.427250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5897f5-4a27-4d31-8d92-dac46a9a7748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.429243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5897f5-4a27-4d31-8d92-dac46a9a7748 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.439862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 350/698] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:37.439862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbe805-bcdc-4570-98be-4772e2a6a43a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.463309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.515672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.560978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbe805-bcdc-4570-98be-4772e2a6a43a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.561844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 349/699] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:37.562744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5897f5-4a27-4d31-8d92-dac46a9a7748 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.613217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c7f1-3448-4620-8cc1-d81b8e3327bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.614791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c7f1-3448-4620-8cc1-d81b8e3327bc None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.615412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c7f1-3448-4620-8cc1-d81b8e3327bc None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.615720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c7f1-3448-4620-8cc1-d81b8e3327bc None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.616453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c7f1-3448-4620-8cc1-d81b8e3327bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:37.617108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c7f1-3448-4620-8cc1-d81b8e3327bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.619224 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c7f1-3448-4620-8cc1-d81b8e3327bc None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.636770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 351/700] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:37.638306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c7f1-3448-4620-8cc1-d81b8e3327bc None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.681615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5897f5-4a27-4d31-8d92-dac46a9a7748 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.707073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.718663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc1e99-0908-443d-abe9-969c4da70865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.719434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc1e99-0908-443d-abe9-969c4da70865 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.719765 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc1e99-0908-443d-abe9-969c4da70865 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.729265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc1e99-0908-443d-abe9-969c4da70865 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.729265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc1e99-0908-443d-abe9-969c4da70865 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.729265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc1e99-0908-443d-abe9-969c4da70865 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.763406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c7f1-3448-4620-8cc1-d81b8e3327bc None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:37.795008 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:37.800416 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5f0b-9efe-451a-9172-eba252ce8614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:37.801334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5f0b-9efe-451a-9172-eba252ce8614 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:37.801619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5f0b-9efe-451a-9172-eba252ce8614 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:37.801896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5f0b-9efe-451a-9172-eba252ce8614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:37.811829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac5f0b-9efe-451a-9172-eba252ce8614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:37.813277 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac5f0b-9efe-451a-9172-eba252ce8614 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:37.831785 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 350/701] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:54:37 2022] POST /identity/v3/users => generated 254 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-b4ac5f0b-9efe-451a-9172-eba252ce8614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:37.832355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:37.834085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:37.835899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:37.835899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:37.835899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:37.835899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:37.835899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 352/702] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:37.837474 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc1e99-0908-443d-abe9-969c4da70865 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:37.841325 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5f0b-9efe-451a-9172-eba252ce8614 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.035223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5f0b-9efe-451a-9172-eba252ce8614 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.053484 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc1e99-0908-443d-abe9-969c4da70865 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.081387 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe4347-41e2-46a0-aee1-cbd50641b507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.082074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4347-41e2-46a0-aee1-cbd50641b507 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.083318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4347-41e2-46a0-aee1-cbd50641b507 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.083625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe4347-41e2-46a0-aee1-cbd50641b507 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.084564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe4347-41e2-46a0-aee1-cbd50641b507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:38.085119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe4347-41e2-46a0-aee1-cbd50641b507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.086562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe4347-41e2-46a0-aee1-cbd50641b507 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.108685 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 353/703] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:38.114632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe4347-41e2-46a0-aee1-cbd50641b507 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.115273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc26a0-da1e-4a75-8e4d-ce4265af2bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.116060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc26a0-da1e-4a75-8e4d-ce4265af2bde None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.116346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc26a0-da1e-4a75-8e4d-ce4265af2bde None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.116622 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc26a0-da1e-4a75-8e4d-ce4265af2bde None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.124801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc26a0-da1e-4a75-8e4d-ce4265af2bde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.126403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc26a0-da1e-4a75-8e4d-ce4265af2bde None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-d8cc26a0-da1e-4a75-8e4d-ce4265af2bde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:38.142084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:38.143159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:38.144716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:38.144716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:38.144716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:38.144716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:38.144716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:38.144716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:38.144716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:38.144716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:38.144716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 351/704] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:38.150569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc26a0-da1e-4a75-8e4d-ce4265af2bde None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.170801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.199994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.246213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe4347-41e2-46a0-aee1-cbd50641b507 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.277011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc26a0-da1e-4a75-8e4d-ce4265af2bde None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.303867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306cf2f-247f-4e31-84db-305acff35df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.304702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306cf2f-247f-4e31-84db-305acff35df7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.304996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306cf2f-247f-4e31-84db-305acff35df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.305276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306cf2f-247f-4e31-84db-305acff35df7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.316159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306cf2f-247f-4e31-84db-305acff35df7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.318234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306cf2f-247f-4e31-84db-305acff35df7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.328822 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22f98d-7ce8-4c6a-81e3-b9f352942fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.329770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f98d-7ce8-4c6a-81e3-b9f352942fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.330269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f98d-7ce8-4c6a-81e3-b9f352942fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.330735 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22f98d-7ce8-4c6a-81e3-b9f352942fb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.331757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22f98d-7ce8-4c6a-81e3-b9f352942fb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:38.332258 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22f98d-7ce8-4c6a-81e3-b9f352942fb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.334681 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22f98d-7ce8-4c6a-81e3-b9f352942fb8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-c306cf2f-247f-4e31-84db-305acff35df7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:38.338657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:38.339575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:38.340528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:38.340528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:38.340528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:38.340528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:38.340528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:38.340528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:38.340528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:38.340528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:38.340528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 354/705] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:38.346457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306cf2f-247f-4e31-84db-305acff35df7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.353585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 352/706] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:38.359962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22f98d-7ce8-4c6a-81e3-b9f352942fb8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.495673 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.498266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306cf2f-247f-4e31-84db-305acff35df7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.499459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22f98d-7ce8-4c6a-81e3-b9f352942fb8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.502955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.543630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1d0b-ba8b-4ea6-86ea-c54ed3c7005a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.544637 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1d0b-ba8b-4ea6-86ea-c54ed3c7005a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.545112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1d0b-ba8b-4ea6-86ea-c54ed3c7005a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.545592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1d0b-ba8b-4ea6-86ea-c54ed3c7005a None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.546596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af1d0b-ba8b-4ea6-86ea-c54ed3c7005a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:38.547102 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af1d0b-ba8b-4ea6-86ea-c54ed3c7005a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.549282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af1d0b-ba8b-4ea6-86ea-c54ed3c7005a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.564292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 355/707] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:38.574221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1d0b-ba8b-4ea6-86ea-c54ed3c7005a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.576324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78e699-031f-459d-aaaa-28503435e3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.576994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78e699-031f-459d-aaaa-28503435e3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.577276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78e699-031f-459d-aaaa-28503435e3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.577554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78e699-031f-459d-aaaa-28503435e3f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.578502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78e699-031f-459d-aaaa-28503435e3f7 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=ba690590103a4019a56b191e8dfe3231) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:38.578819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78e699-031f-459d-aaaa-28503435e3f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.580371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78e699-031f-459d-aaaa-28503435e3f7 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.591611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 353/708] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/role_assignments?user.id=ba690590103a4019a56b191e8dfe3231&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=918b179f19b6437493eabe5394fa9af0 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:38.603616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c41f8-3802-42dc-ab24-e534722baedd None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.603616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c41f8-3802-42dc-ab24-e534722baedd None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.603616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c41f8-3802-42dc-ab24-e534722baedd None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.610191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 354/709] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:38.611605 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef74ce-927f-4128-8cab-cf3b25fb8987 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.611908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef74ce-927f-4128-8cab-cf3b25fb8987 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.612192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef74ce-927f-4128-8cab-cf3b25fb8987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.646983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-66ef74ce-927f-4128-8cab-cf3b25fb8987 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:38.650637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-66ef74ce-927f-4128-8cab-cf3b25fb8987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:38.759338 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1d0b-ba8b-4ea6-86ea-c54ed3c7005a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:38.778336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 355/710] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:38.782270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937e01b-4952-4952-9bc1-79f9e1619323 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.782270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937e01b-4952-4952-9bc1-79f9e1619323 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.782270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937e01b-4952-4952-9bc1-79f9e1619323 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.782270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 356/711] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:38.789390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010045a-bbbe-4568-8f38-067a59d29764 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.789697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010045a-bbbe-4568-8f38-067a59d29764 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.790074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010045a-bbbe-4568-8f38-067a59d29764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.803712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039e77-8679-4749-a20a-e68d0137869c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:38.813044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039e77-8679-4749-a20a-e68d0137869c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:38.813044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039e77-8679-4749-a20a-e68d0137869c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:38.813044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039e77-8679-4749-a20a-e68d0137869c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:38.813044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9039e77-8679-4749-a20a-e68d0137869c None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=842ffae8f3b04107b994e57bc880b59b) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:38.813044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9039e77-8679-4749-a20a-e68d0137869c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:38.813044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9039e77-8679-4749-a20a-e68d0137869c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:38.813523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c010045a-bbbe-4568-8f38-067a59d29764 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:38.813523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c010045a-bbbe-4568-8f38-067a59d29764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:38.815409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 356/712] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/role_assignments?user.id=842ffae8f3b04107b994e57bc880b59b&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:38.820716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039e77-8679-4749-a20a-e68d0137869c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.886199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:38.894033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 357/713] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:38.916816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010045a-bbbe-4568-8f38-067a59d29764 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:38.944004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:39.043384 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039e77-8679-4749-a20a-e68d0137869c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.053058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010045a-bbbe-4568-8f38-067a59d29764 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.084474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f82027-b14b-49d1-9c78-23159e712c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.085718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f82027-b14b-49d1-9c78-23159e712c07 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.086177 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f82027-b14b-49d1-9c78-23159e712c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.086621 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f82027-b14b-49d1-9c78-23159e712c07 None admin] PATH_INFO: `/v3/services/network` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.087461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f82027-b14b-49d1-9c78-23159e712c07 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.089158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f82027-b14b-49d1-9c78-23159e712c07 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.089808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705888b1-17c0-4b88-bc72-5e14c2f405bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.090692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705888b1-17c0-4b88-bc72-5e14c2f405bc None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.091062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705888b1-17c0-4b88-bc72-5e14c2f405bc None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.091413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705888b1-17c0-4b88-bc72-5e14c2f405bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.092196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705888b1-17c0-4b88-bc72-5e14c2f405bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.093629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705888b1-17c0-4b88-bc72-5e14c2f405bc None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-80f82027-b14b-49d1-9c78-23159e712c07 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:39.105818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:39.107001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:39.107919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-705888b1-17c0-4b88-bc72-5e14c2f405bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:39.108661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:39.109531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:39.111406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 358/714] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:39.119902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 357/715] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:38 2022] GET /identity/v3/services/network => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:39.120936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705888b1-17c0-4b88-bc72-5e14c2f405bc None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.121850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f82027-b14b-49d1-9c78-23159e712c07 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.227935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:39.243564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705888b1-17c0-4b88-bc72-5e14c2f405bc None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.249060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:39.261356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f82027-b14b-49d1-9c78-23159e712c07 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.289962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375670c-92cd-4924-aa15-ac200c3af35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.291425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375670c-92cd-4924-aa15-ac200c3af35c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.292121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375670c-92cd-4924-aa15-ac200c3af35c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.292811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375670c-92cd-4924-aa15-ac200c3af35c None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.293891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375670c-92cd-4924-aa15-ac200c3af35c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:39.294361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375670c-92cd-4924-aa15-ac200c3af35c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.296550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375670c-92cd-4924-aa15-ac200c3af35c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.304195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 359/716] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:39.309933 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375670c-92cd-4924-aa15-ac200c3af35c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.310897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30076a-21be-43bf-ab7f-5735ed350672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.311571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30076a-21be-43bf-ab7f-5735ed350672 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.311877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30076a-21be-43bf-ab7f-5735ed350672 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.312157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30076a-21be-43bf-ab7f-5735ed350672 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.312872 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30076a-21be-43bf-ab7f-5735ed350672 None admin] RBAC: Adding query filter params (name=network) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:39.313185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30076a-21be-43bf-ab7f-5735ed350672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.314574 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30076a-21be-43bf-ab7f-5735ed350672 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.324861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 358/717] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:39.336437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30076a-21be-43bf-ab7f-5735ed350672 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:39.434009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375670c-92cd-4924-aa15-ac200c3af35c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.447805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30076a-21be-43bf-ab7f-5735ed350672 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:39.473276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf4eca-489b-49fe-81e2-c8bba521508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.474326 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf4eca-489b-49fe-81e2-c8bba521508c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.474835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf4eca-489b-49fe-81e2-c8bba521508c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.475317 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf4eca-489b-49fe-81e2-c8bba521508c None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.476412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf4eca-489b-49fe-81e2-c8bba521508c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:39.476935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf4eca-489b-49fe-81e2-c8bba521508c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.478633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf4eca-489b-49fe-81e2-c8bba521508c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.484170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4e022-3afe-40a1-a49d-de4eaf2ff5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:39.484848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4e022-3afe-40a1-a49d-de4eaf2ff5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:39.485138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4e022-3afe-40a1-a49d-de4eaf2ff5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:39.485422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4e022-3afe-40a1-a49d-de4eaf2ff5e3 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:39.486142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4e022-3afe-40a1-a49d-de4eaf2ff5e3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:39.486576 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4e022-3afe-40a1-a49d-de4eaf2ff5e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:39.487015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 360/718] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:39.488865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4e022-3afe-40a1-a49d-de4eaf2ff5e3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:39.495948 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 359/719] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:54:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:40.883550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82abc21-6b5a-470b-9638-d8a860273c78 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.884521 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82abc21-6b5a-470b-9638-d8a860273c78 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.885008 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82abc21-6b5a-470b-9638-d8a860273c78 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.886800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 361/720] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:40.892563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636200-33a7-48d1-8e3e-8dedd2725d3d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:40.893383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636200-33a7-48d1-8e3e-8dedd2725d3d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:40.893880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636200-33a7-48d1-8e3e-8dedd2725d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:40.919651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-34636200-33a7-48d1-8e3e-8dedd2725d3d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:40.921182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-34636200-33a7-48d1-8e3e-8dedd2725d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:40.946794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.024970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 360/721] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:41.066601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82abc21-6b5a-470b-9638-d8a860273c78 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.094478 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.234234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82abc21-6b5a-470b-9638-d8a860273c78 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.276479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e16e91-0856-4060-a6ee-fda78d50ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.277276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e16e91-0856-4060-a6ee-fda78d50ec1a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.277556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e16e91-0856-4060-a6ee-fda78d50ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.277828 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e16e91-0856-4060-a6ee-fda78d50ec1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.293789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e16e91-0856-4060-a6ee-fda78d50ec1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-b2e16e91-0856-4060-a6ee-fda78d50ec1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:41.302050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:41.302996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:41.303876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 362/722] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:41.310732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636200-33a7-48d1-8e3e-8dedd2725d3d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.352060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab947c6-eaef-4b26-a1ee-a4c130a89b35 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.352368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab947c6-eaef-4b26-a1ee-a4c130a89b35 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.352626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab947c6-eaef-4b26-a1ee-a4c130a89b35 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.354242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 363/723] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:41.360210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bf517-3123-4205-8f94-b3ac8a035e3c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.360594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bf517-3123-4205-8f94-b3ac8a035e3c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.360971 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bf517-3123-4205-8f94-b3ac8a035e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.390914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-120bf517-3123-4205-8f94-b3ac8a035e3c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:41.392266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-120bf517-3123-4205-8f94-b3ac8a035e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:41.495446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34636200-33a7-48d1-8e3e-8dedd2725d3d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.498855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 364/724] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 09:54:41.522324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bf517-3123-4205-8f94-b3ac8a035e3c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.530980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.558259 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e857633-0304-451c-9194-ba4ea0a2972a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.561145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e857633-0304-451c-9194-ba4ea0a2972a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.561622 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e857633-0304-451c-9194-ba4ea0a2972a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.562079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e857633-0304-451c-9194-ba4ea0a2972a None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.563104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e857633-0304-451c-9194-ba4ea0a2972a None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:41.564403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e857633-0304-451c-9194-ba4ea0a2972a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:41.569467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e857633-0304-451c-9194-ba4ea0a2972a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:41.585426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 361/725] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:41.590983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e857633-0304-451c-9194-ba4ea0a2972a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.620012 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.675163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bf517-3123-4205-8f94-b3ac8a035e3c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.726763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e857633-0304-451c-9194-ba4ea0a2972a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.728805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0347a-2006-4d81-8c52-6b190bd10986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.730459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0347a-2006-4d81-8c52-6b190bd10986 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.730459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0347a-2006-4d81-8c52-6b190bd10986 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.730459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0347a-2006-4d81-8c52-6b190bd10986 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.762832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0347a-2006-4d81-8c52-6b190bd10986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:41.767728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb5f10-e73a-413b-8341-f56d04aecf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:41.768850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb5f10-e73a-413b-8341-f56d04aecf36 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:41.769323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb5f10-e73a-413b-8341-f56d04aecf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:41.770484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb5f10-e73a-413b-8341-f56d04aecf36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-20e0347a-2006-4d81-8c52-6b190bd10986 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:41.773604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:41.774560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:41.775393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 365/726] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:41.786255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb5f10-e73a-413b-8341-f56d04aecf36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:41.788103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfb5f10-e73a-413b-8341-f56d04aecf36 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:41.792626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0347a-2006-4d81-8c52-6b190bd10986 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2cfb5f10-e73a-413b-8341-f56d04aecf36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:41.813140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:41.814281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:41.815379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:41.815379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:41.815379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:41.815379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:41.818706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 362/727] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:41.828665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb5f10-e73a-413b-8341-f56d04aecf36 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:41.895613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.952124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:41.966214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0347a-2006-4d81-8c52-6b190bd10986 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:41.974783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb5f10-e73a-413b-8341-f56d04aecf36 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.037616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebd613-5b67-44ac-bd42-2e79b0105d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.038298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebd613-5b67-44ac-bd42-2e79b0105d81 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.038585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebd613-5b67-44ac-bd42-2e79b0105d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.038863 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebd613-5b67-44ac-bd42-2e79b0105d81 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.039688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebd613-5b67-44ac-bd42-2e79b0105d81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:42.039947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebd613-5b67-44ac-bd42-2e79b0105d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.041884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebd613-5b67-44ac-bd42-2e79b0105d81 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.046487 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a40cd-b5f5-4e3f-9156-f3e3bd6fc30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.047166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a40cd-b5f5-4e3f-9156-f3e3bd6fc30a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.047450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a40cd-b5f5-4e3f-9156-f3e3bd6fc30a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.047751 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a40cd-b5f5-4e3f-9156-f3e3bd6fc30a None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.048485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a40cd-b5f5-4e3f-9156-f3e3bd6fc30a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:42.048792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a40cd-b5f5-4e3f-9156-f3e3bd6fc30a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.050162 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a40cd-b5f5-4e3f-9156-f3e3bd6fc30a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.065736 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 366/728] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:42.072166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebd613-5b67-44ac-bd42-2e79b0105d81 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.077662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 363/729] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:42.085057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a40cd-b5f5-4e3f-9156-f3e3bd6fc30a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.202492 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a40cd-b5f5-4e3f-9156-f3e3bd6fc30a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.228023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.242041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be7479-9dcb-4f79-99bc-4cce2106fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.242864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be7479-9dcb-4f79-99bc-4cce2106fde0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.243147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be7479-9dcb-4f79-99bc-4cce2106fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.243427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be7479-9dcb-4f79-99bc-4cce2106fde0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.253041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be7479-9dcb-4f79-99bc-4cce2106fde0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.256189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be7479-9dcb-4f79-99bc-4cce2106fde0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.258518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebd613-5b67-44ac-bd42-2e79b0105d81 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-93be7479-9dcb-4f79-99bc-4cce2106fde0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:42.275495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:42.277040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 364/730] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:42.278611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200d84-775f-4f9e-9d84-91e1ef8a0bc4 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.279693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200d84-775f-4f9e-9d84-91e1ef8a0bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.279693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76200d84-775f-4f9e-9d84-91e1ef8a0bc4 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.284425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 365/731] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:42.284425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200d84-775f-4f9e-9d84-91e1ef8a0bc4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.292566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.300622 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f086d-429e-42dc-bf53-46ba2f286f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.301868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f086d-429e-42dc-bf53-46ba2f286f18 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.302259 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f086d-429e-42dc-bf53-46ba2f286f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.302637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f086d-429e-42dc-bf53-46ba2f286f18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.314029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f086d-429e-42dc-bf53-46ba2f286f18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.315489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f086d-429e-42dc-bf53-46ba2f286f18 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-f43f086d-429e-42dc-bf53-46ba2f286f18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:42.335253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:42.336288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:42.337184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:42.337184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:42.337184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:42.337184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:42.337184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 367/732] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:42.337914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e04d5-0bc7-4681-99a4-e8dcb66fbce2 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.337914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e04d5-0bc7-4681-99a4-e8dcb66fbce2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.338199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e04d5-0bc7-4681-99a4-e8dcb66fbce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.355627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7f3e04d5-0bc7-4681-99a4-e8dcb66fbce2 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:42.356800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7f3e04d5-0bc7-4681-99a4-e8dcb66fbce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:42.400154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76200d84-775f-4f9e-9d84-91e1ef8a0bc4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.427982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 368/733] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:42.433737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bf98a-c1d2-49c1-8eba-a4bdea4f0368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.434404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bf98a-c1d2-49c1-8eba-a4bdea4f0368 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.434687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bf98a-c1d2-49c1-8eba-a4bdea4f0368 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.434960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bf98a-c1d2-49c1-8eba-a4bdea4f0368 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.438852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bf98a-c1d2-49c1-8eba-a4bdea4f0368 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:42.438852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bf98a-c1d2-49c1-8eba-a4bdea4f0368 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.439171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9722e2-5c6b-47bc-b605-02864063e25e None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.439171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9722e2-5c6b-47bc-b605-02864063e25e None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.439329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bf98a-c1d2-49c1-8eba-a4bdea4f0368 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.439399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9722e2-5c6b-47bc-b605-02864063e25e None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.439646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 369/734] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:42.440382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9722e2-5c6b-47bc-b605-02864063e25e None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.461522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 366/735] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:42.463237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96670d-97b9-45e1-a56e-956ed36bc8b6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.463760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96670d-97b9-45e1-a56e-956ed36bc8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.464239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96670d-97b9-45e1-a56e-956ed36bc8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.481220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1c96670d-97b9-45e1-a56e-956ed36bc8b6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:42.482414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1c96670d-97b9-45e1-a56e-956ed36bc8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:42.521072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.552991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9722e2-5c6b-47bc-b605-02864063e25e None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.553550 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 367/736] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:42.554391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96670d-97b9-45e1-a56e-956ed36bc8b6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.563943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.590339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41699ec-fa6b-4b86-ab9e-698809f70828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.591005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41699ec-fa6b-4b86-ab9e-698809f70828 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.591293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41699ec-fa6b-4b86-ab9e-698809f70828 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.591574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41699ec-fa6b-4b86-ab9e-698809f70828 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.592423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41699ec-fa6b-4b86-ab9e-698809f70828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:42.593655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41699ec-fa6b-4b86-ab9e-698809f70828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.595455 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41699ec-fa6b-4b86-ab9e-698809f70828 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.607334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 370/737] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:42.608157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41699ec-fa6b-4b86-ab9e-698809f70828 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.658417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96670d-97b9-45e1-a56e-956ed36bc8b6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.692423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b373023-0e99-4550-be9a-c0079a515849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.693214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373023-0e99-4550-be9a-c0079a515849 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.693499 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373023-0e99-4550-be9a-c0079a515849 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.693836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b373023-0e99-4550-be9a-c0079a515849 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.703858 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b373023-0e99-4550-be9a-c0079a515849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:42.705935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41699ec-fa6b-4b86-ab9e-698809f70828 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-7b373023-0e99-4550-be9a-c0079a515849 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:42.712372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:42.713488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:42.714547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 368/738] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:42.715398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db73d4-e3e1-478a-b9de-12623772ee04 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.715398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db73d4-e3e1-478a-b9de-12623772ee04 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.715398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db73d4-e3e1-478a-b9de-12623772ee04 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.719933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 369/739] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:42.719933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db73d4-e3e1-478a-b9de-12623772ee04 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.745016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb22f18-7428-4e7b-a3b5-57381df6adef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.745658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb22f18-7428-4e7b-a3b5-57381df6adef None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.745940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb22f18-7428-4e7b-a3b5-57381df6adef None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.746217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb22f18-7428-4e7b-a3b5-57381df6adef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.751574 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.785938 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:42.813683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb22f18-7428-4e7b-a3b5-57381df6adef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.815080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb22f18-7428-4e7b-a3b5-57381df6adef None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.821791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db73d4-e3e1-478a-b9de-12623772ee04 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:42.853623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689da80-a3e1-4475-bcd7-fc4bf373765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:42.854275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689da80-a3e1-4475-bcd7-fc4bf373765d None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:42.854556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689da80-a3e1-4475-bcd7-fc4bf373765d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:42.854836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689da80-a3e1-4475-bcd7-fc4bf373765d None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:42.855551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689da80-a3e1-4475-bcd7-fc4bf373765d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:42.856939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689da80-a3e1-4475-bcd7-fc4bf373765d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:42.913053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 371/740] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 09:54:42.914133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb22f18-7428-4e7b-a3b5-57381df6adef None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.950098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 370/741] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:54:42 2022] POST /identity/v3/services => generated 240 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:42.951001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689da80-a3e1-4475-bcd7-fc4bf373765d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:42.995803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.030672 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb22f18-7428-4e7b-a3b5-57381df6adef None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.058714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.077304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c97be-e946-467d-813b-6a6c16264c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.078059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c97be-e946-467d-813b-6a6c16264c80 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.078343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c97be-e946-467d-813b-6a6c16264c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.078620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c97be-e946-467d-813b-6a6c16264c80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.082384 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689da80-a3e1-4475-bcd7-fc4bf373765d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.087100 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c97be-e946-467d-813b-6a6c16264c80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.088724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c97be-e946-467d-813b-6a6c16264c80 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-629c97be-e946-467d-813b-6a6c16264c80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:43.105477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:43.106540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 372/742] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511430-90bf-421a-8aea-20ca11c90e9e None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.112355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511430-90bf-421a-8aea-20ca11c90e9e None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.113058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a511430-90bf-421a-8aea-20ca11c90e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.127739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-6a511430-90bf-421a-8aea-20ca11c90e9e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:43.127947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8351-4e14-4e62-961e-40dbfe79be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.128493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8351-4e14-4e62-961e-40dbfe79be2e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.128777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8351-4e14-4e62-961e-40dbfe79be2e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.129521 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6a511430-90bf-421a-8aea-20ca11c90e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:43.129701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8351-4e14-4e62-961e-40dbfe79be2e None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.130483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e8351-4e14-4e62-961e-40dbfe79be2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:43.130795 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e8351-4e14-4e62-961e-40dbfe79be2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.132261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e8351-4e14-4e62-961e-40dbfe79be2e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.145468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 371/743] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:43.145468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8351-4e14-4e62-961e-40dbfe79be2e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.207806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 373/744] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:43 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 09:54:43.208932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a511430-90bf-421a-8aea-20ca11c90e9e None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.264623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8351-4e14-4e62-961e-40dbfe79be2e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.271117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.302847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666c654-6fa5-459d-9319-b052a5561943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.303624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666c654-6fa5-459d-9319-b052a5561943 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.303911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666c654-6fa5-459d-9319-b052a5561943 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.304193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666c654-6fa5-459d-9319-b052a5561943 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.315886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666c654-6fa5-459d-9319-b052a5561943 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.317906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666c654-6fa5-459d-9319-b052a5561943 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.318569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a511430-90bf-421a-8aea-20ca11c90e9e None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-1666c654-6fa5-459d-9319-b052a5561943 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:43.335945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:43.337049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:43.342570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:43.342570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:43.342570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:43.342570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:43.342570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 372/745] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:43.342570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666c654-6fa5-459d-9319-b052a5561943 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.345251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.363046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8625a6-5bfe-4114-b9ad-b4aeecae2bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.363957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8625a6-5bfe-4114-b9ad-b4aeecae2bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.364425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8625a6-5bfe-4114-b9ad-b4aeecae2bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.364706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8625a6-5bfe-4114-b9ad-b4aeecae2bb3 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.365559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8625a6-5bfe-4114-b9ad-b4aeecae2bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:43.365876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8625a6-5bfe-4114-b9ad-b4aeecae2bb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.367313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8625a6-5bfe-4114-b9ad-b4aeecae2bb3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.386068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 374/746] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:43.386878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8625a6-5bfe-4114-b9ad-b4aeecae2bb3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.451019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666c654-6fa5-459d-9319-b052a5561943 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.487053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a874b-1590-4207-bcc0-d2a015f71621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.488690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a874b-1590-4207-bcc0-d2a015f71621 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.488959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a874b-1590-4207-bcc0-d2a015f71621 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.489234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a874b-1590-4207-bcc0-d2a015f71621 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.489830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8625a6-5bfe-4114-b9ad-b4aeecae2bb3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.500174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a874b-1590-4207-bcc0-d2a015f71621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.501623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a874b-1590-4207-bcc0-d2a015f71621 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.505959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6d6a874b-1590-4207-bcc0-d2a015f71621 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:43.520617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:43.521617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:43.522504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:43.522504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:43.522504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:43.522504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:43.522504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 373/747] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:43.522790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a874b-1590-4207-bcc0-d2a015f71621 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.529482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d60c3-c2c8-43fb-89bb-8d723eea4944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.530206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d60c3-c2c8-43fb-89bb-8d723eea4944 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.530503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d60c3-c2c8-43fb-89bb-8d723eea4944 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.530757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d60c3-c2c8-43fb-89bb-8d723eea4944 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.531477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d60c3-c2c8-43fb-89bb-8d723eea4944 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.532870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d60c3-c2c8-43fb-89bb-8d723eea4944 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.581808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.619688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 375/748] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:54:43 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:43.619688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d60c3-c2c8-43fb-89bb-8d723eea4944 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.627611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a874b-1590-4207-bcc0-d2a015f71621 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.673557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cffb84-a7ed-4cac-a591-a0cf12488719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.674270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cffb84-a7ed-4cac-a591-a0cf12488719 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.674551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cffb84-a7ed-4cac-a591-a0cf12488719 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.674821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cffb84-a7ed-4cac-a591-a0cf12488719 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.675547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cffb84-a7ed-4cac-a591-a0cf12488719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:43.676406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cffb84-a7ed-4cac-a591-a0cf12488719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.677815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cffb84-a7ed-4cac-a591-a0cf12488719 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.695650 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 374/749] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:43.695650 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cffb84-a7ed-4cac-a591-a0cf12488719 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.777626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d60c3-c2c8-43fb-89bb-8d723eea4944 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.824389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60eca2-02d9-439f-9214-083850700f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.825387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60eca2-02d9-439f-9214-083850700f1b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.825689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60eca2-02d9-439f-9214-083850700f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.825812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cffb84-a7ed-4cac-a591-a0cf12488719 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:43.825975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60eca2-02d9-439f-9214-083850700f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.838512 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60eca2-02d9-439f-9214-083850700f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.840266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60eca2-02d9-439f-9214-083850700f1b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.845759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-ca60eca2-02d9-439f-9214-083850700f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:43.860273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:43.861213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:43.862123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:43.862123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:43.862123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:43.862123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:43.862123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 376/750] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:43.863002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60eca2-02d9-439f-9214-083850700f1b None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.867833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd09e06-9ed1-428c-abff-fc39b06a2f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:43.868771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd09e06-9ed1-428c-abff-fc39b06a2f18 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:43.869264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd09e06-9ed1-428c-abff-fc39b06a2f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:43.869802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd09e06-9ed1-428c-abff-fc39b06a2f18 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:43.870765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd09e06-9ed1-428c-abff-fc39b06a2f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:43.871369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd09e06-9ed1-428c-abff-fc39b06a2f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:43.872986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd09e06-9ed1-428c-abff-fc39b06a2f18 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:43.887844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 375/751] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:43.888974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd09e06-9ed1-428c-abff-fc39b06a2f18 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:43.903164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:43.981912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60eca2-02d9-439f-9214-083850700f1b None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.025297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd09e06-9ed1-428c-abff-fc39b06a2f18 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.027775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd2aeb-1857-499e-9fea-e02545ee9b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.028575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd2aeb-1857-499e-9fea-e02545ee9b9c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.028858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd2aeb-1857-499e-9fea-e02545ee9b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.029129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd2aeb-1857-499e-9fea-e02545ee9b9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.036284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd2aeb-1857-499e-9fea-e02545ee9b9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.037806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd2aeb-1857-499e-9fea-e02545ee9b9c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-95bd2aeb-1857-499e-9fea-e02545ee9b9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:44.053255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:44.057328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:44.058225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:44.058225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:44.058225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:44.058225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:44.058225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:44.058225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:44.058225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:44.058225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:44.058225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 377/752] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:44.058225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd2aeb-1857-499e-9fea-e02545ee9b9c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.064138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0aaf9-8383-4ee6-a3c4-693ec7479d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.064805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0aaf9-8383-4ee6-a3c4-693ec7479d16 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.065091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0aaf9-8383-4ee6-a3c4-693ec7479d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.065811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e0aaf9-8383-4ee6-a3c4-693ec7479d16 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.067119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0aaf9-8383-4ee6-a3c4-693ec7479d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:44.067437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0aaf9-8383-4ee6-a3c4-693ec7479d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.069255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e0aaf9-8383-4ee6-a3c4-693ec7479d16 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.086013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 376/753] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:44.086895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0aaf9-8383-4ee6-a3c4-693ec7479d16 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.127493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.188959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd2aeb-1857-499e-9fea-e02545ee9b9c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.205897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e0aaf9-8383-4ee6-a3c4-693ec7479d16 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.211958 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.235265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41667100-79bc-4120-91cf-dd172b002110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.236199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41667100-79bc-4120-91cf-dd172b002110 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.236488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41667100-79bc-4120-91cf-dd172b002110 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.239374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41667100-79bc-4120-91cf-dd172b002110 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.247287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d091db4-4b36-4b31-82e5-2769711f4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.247486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41667100-79bc-4120-91cf-dd172b002110 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.248310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d091db4-4b36-4b31-82e5-2769711f4d66 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.248772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d091db4-4b36-4b31-82e5-2769711f4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.248979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41667100-79bc-4120-91cf-dd172b002110 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.249461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d091db4-4b36-4b31-82e5-2769711f4d66 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.250465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d091db4-4b36-4b31-82e5-2769711f4d66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:44.251101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d091db4-4b36-4b31-82e5-2769711f4d66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.253292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d091db4-4b36-4b31-82e5-2769711f4d66 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-41667100-79bc-4120-91cf-dd172b002110 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:44.264581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:44.265591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 378/754] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:44.266704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41667100-79bc-4120-91cf-dd172b002110 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.270593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 377/755] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:44.275452 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d091db4-4b36-4b31-82e5-2769711f4d66 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.376118 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41667100-79bc-4120-91cf-dd172b002110 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.388641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.399185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d091db4-4b36-4b31-82e5-2769711f4d66 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.413851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d1b52-7c25-4eb7-9a8c-182d6d5613cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.414614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1b52-7c25-4eb7-9a8c-182d6d5613cc None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.415031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1b52-7c25-4eb7-9a8c-182d6d5613cc None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.415407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1b52-7c25-4eb7-9a8c-182d6d5613cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.423742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d1b52-7c25-4eb7-9a8c-182d6d5613cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.426097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d1b52-7c25-4eb7-9a8c-182d6d5613cc None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.436728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4570e-a0a7-491e-b37e-fc96ebc2a1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.437776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4570e-a0a7-491e-b37e-fc96ebc2a1bf None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.438534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4570e-a0a7-491e-b37e-fc96ebc2a1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.439035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4570e-a0a7-491e-b37e-fc96ebc2a1bf None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.440468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4570e-a0a7-491e-b37e-fc96ebc2a1bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:44.441041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4570e-a0a7-491e-b37e-fc96ebc2a1bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.442813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4570e-a0a7-491e-b37e-fc96ebc2a1bf None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-1c3d1b52-7c25-4eb7-9a8c-182d6d5613cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:44.444169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:44.445096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:44.446593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:44.446593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:44.446593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:44.446593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:44.446593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:44.446593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:44.446593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:44.446593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:44.446593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 379/756] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:44.446593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d1b52-7c25-4eb7-9a8c-182d6d5613cc None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.459803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.484495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 378/757] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:44.485505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4570e-a0a7-491e-b37e-fc96ebc2a1bf None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.596624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d1b52-7c25-4eb7-9a8c-182d6d5613cc None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.615982 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4570e-a0a7-491e-b37e-fc96ebc2a1bf None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.639656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42f64c-cc01-4985-8a3b-23720bbb5852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.640560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42f64c-cc01-4985-8a3b-23720bbb5852 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.640995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42f64c-cc01-4985-8a3b-23720bbb5852 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.641418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42f64c-cc01-4985-8a3b-23720bbb5852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.642617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42f64c-cc01-4985-8a3b-23720bbb5852 None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=386b93ddf5434625850806abb77b4b7d) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:44.643085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42f64c-cc01-4985-8a3b-23720bbb5852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.650363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42f64c-cc01-4985-8a3b-23720bbb5852 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.653883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23bada-db77-4673-bc07-88da325ed03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.654884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23bada-db77-4673-bc07-88da325ed03a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.655007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23bada-db77-4673-bc07-88da325ed03a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.655390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23bada-db77-4673-bc07-88da325ed03a None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.656333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23bada-db77-4673-bc07-88da325ed03a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:44.656722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23bada-db77-4673-bc07-88da325ed03a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.658327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23bada-db77-4673-bc07-88da325ed03a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:44.658708 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 380/758] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/role_assignments?user.id=386b93ddf5434625850806abb77b4b7d&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:44.659731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42f64c-cc01-4985-8a3b-23720bbb5852 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.672369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 379/759] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:44.680695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23bada-db77-4673-bc07-88da325ed03a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:44.710393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.757024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:44.801192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42f64c-cc01-4985-8a3b-23720bbb5852 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:44.844289 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d890b-fa34-41ef-a1af-12db80688033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:44.845245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d890b-fa34-41ef-a1af-12db80688033 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:44.845688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d890b-fa34-41ef-a1af-12db80688033 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:44.846232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d890b-fa34-41ef-a1af-12db80688033 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:44.923384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d890b-fa34-41ef-a1af-12db80688033 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:44.925127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d890b-fa34-41ef-a1af-12db80688033 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.005583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.057066 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23bada-db77-4673-bc07-88da325ed03a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.071028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 381/760] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:54:45.080645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d890b-fa34-41ef-a1af-12db80688033 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.114672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d20529-6673-45d5-be4e-aae4b7e9d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.116433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d20529-6673-45d5-be4e-aae4b7e9d4a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.119569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d20529-6673-45d5-be4e-aae4b7e9d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.120085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d20529-6673-45d5-be4e-aae4b7e9d4a4 None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/ba690590103a4019a56b191e8dfe3231/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.123518 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d20529-6673-45d5-be4e-aae4b7e9d4a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=ba690590103a4019a56b191e8dfe3231, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.125423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d20529-6673-45d5-be4e-aae4b7e9d4a4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.212498 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 380/761] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:44 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/ba690590103a4019a56b191e8dfe3231/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:45.312214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d890b-fa34-41ef-a1af-12db80688033 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.383327 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a44be-d168-4d62-a83c-95a8064324e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.384718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a44be-d168-4d62-a83c-95a8064324e7 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.385410 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a44be-d168-4d62-a83c-95a8064324e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.385893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a44be-d168-4d62-a83c-95a8064324e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.402045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a44be-d168-4d62-a83c-95a8064324e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.403977 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a44be-d168-4d62-a83c-95a8064324e7 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.430329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94355438-52ec-4057-847c-7dadcbee1aef None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.430990 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94355438-52ec-4057-847c-7dadcbee1aef None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.431475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94355438-52ec-4057-847c-7dadcbee1aef None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.433114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 381/762] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-301a44be-d168-4d62-a83c-95a8064324e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:45.439239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:45.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:45.441117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:45.441117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:45.441117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:45.441117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:45.441894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fc81b-a933-432b-839c-7a94180b7206 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.441894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fc81b-a933-432b-839c-7a94180b7206 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.441894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fc81b-a933-432b-839c-7a94180b7206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.444317 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 382/763] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:45.454327 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a44be-d168-4d62-a83c-95a8064324e7 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.478144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c41fc81b-a933-432b-839c-7a94180b7206 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:45.478334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c41fc81b-a933-432b-839c-7a94180b7206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:45.520176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.560188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 382/764] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:54:45.560638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.599901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fc81b-a933-432b-839c-7a94180b7206 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.603155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a44be-d168-4d62-a83c-95a8064324e7 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.673345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfad4f2-689a-44f8-abf1-2e50651cf503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.674033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfad4f2-689a-44f8-abf1-2e50651cf503 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.674356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfad4f2-689a-44f8-abf1-2e50651cf503 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.674597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfad4f2-689a-44f8-abf1-2e50651cf503 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.675333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfad4f2-689a-44f8-abf1-2e50651cf503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:45.676182 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfad4f2-689a-44f8-abf1-2e50651cf503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.677677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfad4f2-689a-44f8-abf1-2e50651cf503 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.705140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 383/765] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:45.713502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfad4f2-689a-44f8-abf1-2e50651cf503 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.802201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fc81b-a933-432b-839c-7a94180b7206 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.871574 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3035217-b03b-4454-84e6-468ba75a0d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.872418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035217-b03b-4454-84e6-468ba75a0d01 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.872701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035217-b03b-4454-84e6-468ba75a0d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.872976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3035217-b03b-4454-84e6-468ba75a0d01 None admin] PATH_INFO: `/v3/services/network` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.873643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3035217-b03b-4454-84e6-468ba75a0d01 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:45.875078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3035217-b03b-4454-84e6-468ba75a0d01 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:45.894098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-c3035217-b03b-4454-84e6-468ba75a0d01 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:45.904296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:45.905367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:45.906833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 383/766] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/services/network => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:45.912360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3035217-b03b-4454-84e6-468ba75a0d01 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:45.927058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfad4f2-689a-44f8-abf1-2e50651cf503 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:45.981873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63130125-a3ce-430c-ad56-b2e3eefa4391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:45.984659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63130125-a3ce-430c-ad56-b2e3eefa4391 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:45.984948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63130125-a3ce-430c-ad56-b2e3eefa4391 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:45.985232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63130125-a3ce-430c-ad56-b2e3eefa4391 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:45.999654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63130125-a3ce-430c-ad56-b2e3eefa4391 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.001139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63130125-a3ce-430c-ad56-b2e3eefa4391 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-63130125-a3ce-430c-ad56-b2e3eefa4391 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:46.028450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:46.029853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:46.030749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:46.030749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:46.030749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:46.030749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:46.030749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:46.030749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:46.030749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:46.030749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:46.035607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 384/767] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:46.039782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63130125-a3ce-430c-ad56-b2e3eefa4391 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.042151 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.102208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3035217-b03b-4454-84e6-468ba75a0d01 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.170691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63130125-a3ce-430c-ad56-b2e3eefa4391 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.173760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723bae3-b73d-4335-a064-e6efa2a20f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.174512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723bae3-b73d-4335-a064-e6efa2a20f5a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.174801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723bae3-b73d-4335-a064-e6efa2a20f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.175083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723bae3-b73d-4335-a064-e6efa2a20f5a None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.176478 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723bae3-b73d-4335-a064-e6efa2a20f5a None admin] RBAC: Adding query filter params (name=network) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:46.176794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723bae3-b73d-4335-a064-e6efa2a20f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.178184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723bae3-b73d-4335-a064-e6efa2a20f5a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.191006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 384/768] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:54:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:46.198186 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723bae3-b73d-4335-a064-e6efa2a20f5a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.218678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e5f96-e5e4-447d-9449-4b1554740b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.219406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e5f96-e5e4-447d-9449-4b1554740b9f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.221169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e5f96-e5e4-447d-9449-4b1554740b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.221169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e5f96-e5e4-447d-9449-4b1554740b9f None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.221169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e5f96-e5e4-447d-9449-4b1554740b9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:46.221169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e5f96-e5e4-447d-9449-4b1554740b9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.223115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e5f96-e5e4-447d-9449-4b1554740b9f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.238507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 385/769] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:46.245471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085d11-2fd9-4d96-90dc-e4cf825261bd None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.245771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085d11-2fd9-4d96-90dc-e4cf825261bd None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.246148 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085d11-2fd9-4d96-90dc-e4cf825261bd None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.247908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 386/770] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:46.248697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af085d11-2fd9-4d96-90dc-e4cf825261bd None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.251833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.328609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723bae3-b73d-4335-a064-e6efa2a20f5a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.365316 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.368261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af085d11-2fd9-4d96-90dc-e4cf825261bd None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.375646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3642ca-1417-4e63-8002-9483de8af0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.376318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3642ca-1417-4e63-8002-9483de8af0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.376625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3642ca-1417-4e63-8002-9483de8af0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.377426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3642ca-1417-4e63-8002-9483de8af0f6 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.392821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3642ca-1417-4e63-8002-9483de8af0f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:46.392821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3642ca-1417-4e63-8002-9483de8af0f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.392821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3642ca-1417-4e63-8002-9483de8af0f6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.392821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 385/771] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:46.392821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53e12c-7750-47e4-8469-5ab8189d788a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.392821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53e12c-7750-47e4-8469-5ab8189d788a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.393254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53e12c-7750-47e4-8469-5ab8189d788a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.412236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819f992-5835-4f41-bff8-3d1f56795d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.412952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819f992-5835-4f41-bff8-3d1f56795d24 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.413234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819f992-5835-4f41-bff8-3d1f56795d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.413549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819f992-5835-4f41-bff8-3d1f56795d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.414382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819f992-5835-4f41-bff8-3d1f56795d24 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=842ffae8f3b04107b994e57bc880b59b) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:46.414699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819f992-5835-4f41-bff8-3d1f56795d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.416353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ee53e12c-7750-47e4-8469-5ab8189d788a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:46.417127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819f992-5835-4f41-bff8-3d1f56795d24 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.418270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ee53e12c-7750-47e4-8469-5ab8189d788a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:46.425067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 387/772] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/role_assignments?user.id=842ffae8f3b04107b994e57bc880b59b&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=918b179f19b6437493eabe5394fa9af0 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:46.426727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819f992-5835-4f41-bff8-3d1f56795d24 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.513056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 386/773] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:54:46.515747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.547838 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53e12c-7750-47e4-8469-5ab8189d788a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.561789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819f992-5835-4f41-bff8-3d1f56795d24 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.628217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94e7a6-a623-4868-8228-1f0e5f54c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.628943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94e7a6-a623-4868-8228-1f0e5f54c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.629231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94e7a6-a623-4868-8228-1f0e5f54c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.629509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94e7a6-a623-4868-8228-1f0e5f54c6a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.630320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94e7a6-a623-4868-8228-1f0e5f54c6a3 None admin] RBAC: Adding query filter params (interface=public, service_id=0bef93da0c034a96a708463b68662e8a, region_id=RegionOne) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:46.636688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94e7a6-a623-4868-8228-1f0e5f54c6a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.638243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94e7a6-a623-4868-8228-1f0e5f54c6a3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.651430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 388/774] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/endpoints?service_id=0bef93da0c034a96a708463b68662e8a&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:46.658465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94e7a6-a623-4868-8228-1f0e5f54c6a3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.750271 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53e12c-7750-47e4-8469-5ab8189d788a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.771955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.787092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc329dc-d329-49b1-8789-0efac7c6d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.787946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc329dc-d329-49b1-8789-0efac7c6d0fd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.788231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc329dc-d329-49b1-8789-0efac7c6d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.788511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc329dc-d329-49b1-8789-0efac7c6d0fd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.789183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc329dc-d329-49b1-8789-0efac7c6d0fd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.790583 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc329dc-d329-49b1-8789-0efac7c6d0fd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-afc329dc-d329-49b1-8789-0efac7c6d0fd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:46.803202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:46.804217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:46.805357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 387/775] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:46.813814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc329dc-d329-49b1-8789-0efac7c6d0fd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:46.865587 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94e7a6-a623-4868-8228-1f0e5f54c6a3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.931670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc329dc-d329-49b1-8789-0efac7c6d0fd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:46.947903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:46.965994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854b3a4-7cea-4339-8cb0-7bc746ca1dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.966674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854b3a4-7cea-4339-8cb0-7bc746ca1dca None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.966963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854b3a4-7cea-4339-8cb0-7bc746ca1dca None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.967243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854b3a4-7cea-4339-8cb0-7bc746ca1dca None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.967969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854b3a4-7cea-4339-8cb0-7bc746ca1dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.969410 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854b3a4-7cea-4339-8cb0-7bc746ca1dca None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.983203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 389/776] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/services => generated 772 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:46.986195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f6248-b852-4381-a38f-e68cdd07d51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:46.986886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6248-b852-4381-a38f-e68cdd07d51c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:46.987176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6248-b852-4381-a38f-e68cdd07d51c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:46.987458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f6248-b852-4381-a38f-e68cdd07d51c None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:46.988356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f6248-b852-4381-a38f-e68cdd07d51c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:46.988674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f6248-b852-4381-a38f-e68cdd07d51c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:46.990096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f6248-b852-4381-a38f-e68cdd07d51c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:46.995997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 388/777] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 2 09:54:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:47.005296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854b3a4-7cea-4339-8cb0-7bc746ca1dca None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.150035 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854b3a4-7cea-4339-8cb0-7bc746ca1dca None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.201334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0a06d-6042-41f5-966b-0d7c7f2647d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.201949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a06d-6042-41f5-966b-0d7c7f2647d0 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.202229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a06d-6042-41f5-966b-0d7c7f2647d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.202505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a06d-6042-41f5-966b-0d7c7f2647d0 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.203229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0a06d-6042-41f5-966b-0d7c7f2647d0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:47.203536 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0a06d-6042-41f5-966b-0d7c7f2647d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.204954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0a06d-6042-41f5-966b-0d7c7f2647d0 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.212032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 390/778] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:47.217398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f6248-b852-4381-a38f-e68cdd07d51c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.278496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:47.337887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f6248-b852-4381-a38f-e68cdd07d51c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.383120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982df1a-8c89-4aab-941f-5ef582d3cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.383841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982df1a-8c89-4aab-941f-5ef582d3cb9d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.384133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982df1a-8c89-4aab-941f-5ef582d3cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.384415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982df1a-8c89-4aab-941f-5ef582d3cb9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.385231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982df1a-8c89-4aab-941f-5ef582d3cb9d None admin] RBAC: Adding query filter params (interface=public, service_id=4e01aa02515d41faa1fe6bfcaea7033a, region_id=RegionOne) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:47.385550 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982df1a-8c89-4aab-941f-5ef582d3cb9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.386939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982df1a-8c89-4aab-941f-5ef582d3cb9d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.396214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 389/779] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/endpoints?service_id=4e01aa02515d41faa1fe6bfcaea7033a&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:47.401608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0a06d-6042-41f5-966b-0d7c7f2647d0 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.462915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:47.526638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0a06d-6042-41f5-966b-0d7c7f2647d0 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.560698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522b128-e2bb-4aba-a3e6-35d25dc38d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.561368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b128-e2bb-4aba-a3e6-35d25dc38d6c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.561654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b128-e2bb-4aba-a3e6-35d25dc38d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.561939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522b128-e2bb-4aba-a3e6-35d25dc38d6c None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.562631 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522b128-e2bb-4aba-a3e6-35d25dc38d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:47.564038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522b128-e2bb-4aba-a3e6-35d25dc38d6c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:47.570400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 391/780] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:47.673171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c5ef1-95f7-4076-9c97-62d1f3a390a5 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.673510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c5ef1-95f7-4076-9c97-62d1f3a390a5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.673750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c5ef1-95f7-4076-9c97-62d1f3a390a5 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.679856 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 390/781] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:47.683910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad1de1-5563-472c-aafa-6ad10aef0417 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.684207 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad1de1-5563-472c-aafa-6ad10aef0417 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.684491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad1de1-5563-472c-aafa-6ad10aef0417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.712883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-3cad1de1-5563-472c-aafa-6ad10aef0417 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:47.714250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-3cad1de1-5563-472c-aafa-6ad10aef0417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:47.806707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 392/782] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:54:47.834138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c5ef1-95f7-4076-9c97-62d1f3a390a5 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:47.946323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c5ef1-95f7-4076-9c97-62d1f3a390a5 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:47.963989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:47.987036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2bff9-b9f9-45d6-aa2a-26445da8ac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:47.987036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2bff9-b9f9-45d6-aa2a-26445da8ac62 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:47.987036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2bff9-b9f9-45d6-aa2a-26445da8ac62 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:47.987036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2bff9-b9f9-45d6-aa2a-26445da8ac62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:47.995548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2bff9-b9f9-45d6-aa2a-26445da8ac62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-76d2bff9-b9f9-45d6-aa2a-26445da8ac62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:48.003481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:48.005265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:48.006141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 391/783] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:48.011279 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad1de1-5563-472c-aafa-6ad10aef0417 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.092782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.141349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9a94-b329-48b4-95af-994baebef629 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.141654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9a94-b329-48b4-95af-994baebef629 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.142001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9a94-b329-48b4-95af-994baebef629 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.143564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 392/784] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:48.152186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad1de1-5563-472c-aafa-6ad10aef0417 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.152936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b438cb-66aa-46d3-a23a-c1fa07d66509 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.153228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b438cb-66aa-46d3-a23a-c1fa07d66509 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.153514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b438cb-66aa-46d3-a23a-c1fa07d66509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.185357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d8b438cb-66aa-46d3-a23a-c1fa07d66509 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:48.186541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d8b438cb-66aa-46d3-a23a-c1fa07d66509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:48.202398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39973fc3-06d8-4443-9d52-d078cec73ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.203426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39973fc3-06d8-4443-9d52-d078cec73ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.203947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39973fc3-06d8-4443-9d52-d078cec73ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.204462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39973fc3-06d8-4443-9d52-d078cec73ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.205424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39973fc3-06d8-4443-9d52-d078cec73ec3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:48.205949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39973fc3-06d8-4443-9d52-d078cec73ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.207613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39973fc3-06d8-4443-9d52-d078cec73ec3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.223623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 393/785] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:48.229146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39973fc3-06d8-4443-9d52-d078cec73ec3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.298035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 393/786] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:54:48.341602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b438cb-66aa-46d3-a23a-c1fa07d66509 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.373339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39973fc3-06d8-4443-9d52-d078cec73ec3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.388083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.412621 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb25699-2a5c-4119-aa09-257b7afdb362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.413423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb25699-2a5c-4119-aa09-257b7afdb362 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.413705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb25699-2a5c-4119-aa09-257b7afdb362 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.413974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb25699-2a5c-4119-aa09-257b7afdb362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.437254 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb25699-2a5c-4119-aa09-257b7afdb362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.438719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb25699-2a5c-4119-aa09-257b7afdb362 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-ffb25699-2a5c-4119-aa09-257b7afdb362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:48.467150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:48.468177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:48.469089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:48.469089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:48.469089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:48.469089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:48.475305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 394/787] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:48.481891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb25699-2a5c-4119-aa09-257b7afdb362 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.556102 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b438cb-66aa-46d3-a23a-c1fa07d66509 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.557709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.608002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a8dbb-d7be-43d4-88af-e40e5c0c16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.608814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a8dbb-d7be-43d4-88af-e40e5c0c16c2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.609106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a8dbb-d7be-43d4-88af-e40e5c0c16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.609391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a8dbb-d7be-43d4-88af-e40e5c0c16c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.633163 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a8dbb-d7be-43d4-88af-e40e5c0c16c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:48.645307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb25699-2a5c-4119-aa09-257b7afdb362 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-d68a8dbb-d7be-43d4-88af-e40e5c0c16c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:48.647645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:48.648704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:48.649869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 394/788] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:48.659639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a8dbb-d7be-43d4-88af-e40e5c0c16c2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.711487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d91d5-01de-4531-b0fd-2231aa4b50ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.712260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d91d5-01de-4531-b0fd-2231aa4b50ca None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.712543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d91d5-01de-4531-b0fd-2231aa4b50ca None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.712820 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d91d5-01de-4531-b0fd-2231aa4b50ca None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.713550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d91d5-01de-4531-b0fd-2231aa4b50ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:48.713855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d91d5-01de-4531-b0fd-2231aa4b50ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.715239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d91d5-01de-4531-b0fd-2231aa4b50ca None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.740083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 395/789] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:48.746600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d91d5-01de-4531-b0fd-2231aa4b50ca None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.799980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.848788 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a8dbb-d7be-43d4-88af-e40e5c0c16c2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.909072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325592e-e4b9-4454-908a-12b8c344bf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.909816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325592e-e4b9-4454-908a-12b8c344bf0f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.910088 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325592e-e4b9-4454-908a-12b8c344bf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.910372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325592e-e4b9-4454-908a-12b8c344bf0f None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.911125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325592e-e4b9-4454-908a-12b8c344bf0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:48.911441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325592e-e4b9-4454-908a-12b8c344bf0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.916780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325592e-e4b9-4454-908a-12b8c344bf0f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:48.931711 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 395/790] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:48.936668 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d91d5-01de-4531-b0fd-2231aa4b50ca None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:48.938351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325592e-e4b9-4454-908a-12b8c344bf0f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:48.985052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:48.985472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf700b-9af3-4b92-a4d9-0aab56053b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:48.986292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf700b-9af3-4b92-a4d9-0aab56053b9a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:48.986912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf700b-9af3-4b92-a4d9-0aab56053b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:48.986912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf700b-9af3-4b92-a4d9-0aab56053b9a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:48.997501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf700b-9af3-4b92-a4d9-0aab56053b9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:48.998972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf700b-9af3-4b92-a4d9-0aab56053b9a None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-f4cf700b-9af3-4b92-a4d9-0aab56053b9a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:49.033010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:49.034044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:49.035601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:49.035601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:49.035601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:49.035601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:49.035601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:49.035601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:49.035601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:49.035601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:49.035601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:54:49.035601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:49.035601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 396/791] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:49.042043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf700b-9af3-4b92-a4d9-0aab56053b9a None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.154398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325592e-e4b9-4454-908a-12b8c344bf0f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.195955 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.211885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a13b5-c142-4889-9f3e-daf31082718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.215144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a13b5-c142-4889-9f3e-daf31082718f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.215144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a13b5-c142-4889-9f3e-daf31082718f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.215144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a13b5-c142-4889-9f3e-daf31082718f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.223794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf700b-9af3-4b92-a4d9-0aab56053b9a None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.228478 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a13b5-c142-4889-9f3e-daf31082718f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.228478 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a13b5-c142-4889-9f3e-daf31082718f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-463a13b5-c142-4889-9f3e-daf31082718f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:49.250364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:49.251508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:49.252666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:49.252666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:49.252666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:49.252666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:49.253853 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 396/792] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:49.255177 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2767e82-218d-4445-b971-916a4f9ca365 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.260373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2767e82-218d-4445-b971-916a4f9ca365 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.260749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2767e82-218d-4445-b971-916a4f9ca365 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.266510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 397/793] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:49.266510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2767e82-218d-4445-b971-916a4f9ca365 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.279525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a0711-8ba7-4e72-a5df-2583a9b733ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.280436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0711-8ba7-4e72-a5df-2583a9b733ca None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.280940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0711-8ba7-4e72-a5df-2583a9b733ca None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.281383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0711-8ba7-4e72-a5df-2583a9b733ca None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.282378 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a0711-8ba7-4e72-a5df-2583a9b733ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:49.282873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a0711-8ba7-4e72-a5df-2583a9b733ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.284577 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a0711-8ba7-4e72-a5df-2583a9b733ca None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.304972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 397/794] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:49.306516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14f71-0291-48c3-a87a-ad6370ec6120 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.306988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14f71-0291-48c3-a87a-ad6370ec6120 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.307472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14f71-0291-48c3-a87a-ad6370ec6120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.326507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-dae14f71-0291-48c3-a87a-ad6370ec6120 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:49.328061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-dae14f71-0291-48c3-a87a-ad6370ec6120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:49.366886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.391897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2767e82-218d-4445-b971-916a4f9ca365 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.435699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 398/795] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:54:49.435699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae14f71-0291-48c3-a87a-ad6370ec6120 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.441836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf735c-661a-4d7b-a662-1243cde35378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.442949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf735c-661a-4d7b-a662-1243cde35378 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.443425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf735c-661a-4d7b-a662-1243cde35378 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.443991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf735c-661a-4d7b-a662-1243cde35378 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.444934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf735c-661a-4d7b-a662-1243cde35378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:49.445435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf735c-661a-4d7b-a662-1243cde35378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.447092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf735c-661a-4d7b-a662-1243cde35378 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.472380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 398/796] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:49.476517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf735c-661a-4d7b-a662-1243cde35378 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.526883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.554357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae14f71-0291-48c3-a87a-ad6370ec6120 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.603641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379a3bc-b482-4783-9b6b-99d34dd83760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.604475 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379a3bc-b482-4783-9b6b-99d34dd83760 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.605144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379a3bc-b482-4783-9b6b-99d34dd83760 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.605439 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379a3bc-b482-4783-9b6b-99d34dd83760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.608220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf735c-661a-4d7b-a662-1243cde35378 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.618821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379a3bc-b482-4783-9b6b-99d34dd83760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.620784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379a3bc-b482-4783-9b6b-99d34dd83760 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-5379a3bc-b482-4783-9b6b-99d34dd83760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:49.647114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:49.648120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:49.649013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:49.649013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:49.649013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:49.649013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:49.651426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb924e4-2d67-4b68-bd9a-09961e71f747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.651835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 399/797] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:49.652669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379a3bc-b482-4783-9b6b-99d34dd83760 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.652909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb924e4-2d67-4b68-bd9a-09961e71f747 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.653437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb924e4-2d67-4b68-bd9a-09961e71f747 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.653888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb924e4-2d67-4b68-bd9a-09961e71f747 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.658585 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.667821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb924e4-2d67-4b68-bd9a-09961e71f747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-fdb924e4-2d67-4b68-bd9a-09961e71f747 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:49.676708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:49.677854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:49.678903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:49.679880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 399/798] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:49.685789 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb924e4-2d67-4b68-bd9a-09961e71f747 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.781384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379a3bc-b482-4783-9b6b-99d34dd83760 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.809699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.819244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e6b7f-f96c-4fa8-901b-d94c20d068e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.820073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e6b7f-f96c-4fa8-901b-d94c20d068e7 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.820357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e6b7f-f96c-4fa8-901b-d94c20d068e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.820634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e6b7f-f96c-4fa8-901b-d94c20d068e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.820914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb924e4-2d67-4b68-bd9a-09961e71f747 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:49.829612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e6b7f-f96c-4fa8-901b-d94c20d068e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.831444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e6b7f-f96c-4fa8-901b-d94c20d068e7 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-b95e6b7f-f96c-4fa8-901b-d94c20d068e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:49.849566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:49.850767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 400/799] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:49.857361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e6b7f-f96c-4fa8-901b-d94c20d068e7 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.869413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4489d-f580-4786-9ad5-f2c86cebca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:49.870103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4489d-f580-4786-9ad5-f2c86cebca64 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.870396 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4489d-f580-4786-9ad5-f2c86cebca64 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.871054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4489d-f580-4786-9ad5-f2c86cebca64 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.871832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4489d-f580-4786-9ad5-f2c86cebca64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:49.872488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4489d-f580-4786-9ad5-f2c86cebca64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:49.873926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4489d-f580-4786-9ad5-f2c86cebca64 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:49.886776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 400/800] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:49.889763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123caa8-0c30-4605-a7bf-42595e0c624c None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:49.890490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123caa8-0c30-4605-a7bf-42595e0c624c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:49.891183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123caa8-0c30-4605-a7bf-42595e0c624c None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:49.893156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 401/801] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:49.898153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123caa8-0c30-4605-a7bf-42595e0c624c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:49.959097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:49.971246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e6b7f-f96c-4fa8-901b-d94c20d068e7 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.008094 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123caa8-0c30-4605-a7bf-42595e0c624c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.010412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd9195-9295-4f4b-8d62-4231fa261ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.011089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9195-9295-4f4b-8d62-4231fa261ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.011372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9195-9295-4f4b-8d62-4231fa261ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.011678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd9195-9295-4f4b-8d62-4231fa261ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.012430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd9195-9295-4f4b-8d62-4231fa261ee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:50.012742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd9195-9295-4f4b-8d62-4231fa261ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.014106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd9195-9295-4f4b-8d62-4231fa261ee8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.023040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 401/802] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:50.023878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd9195-9295-4f4b-8d62-4231fa261ee8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.052746 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a067e-8307-4707-8016-aac5f82af8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.053820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a067e-8307-4707-8016-aac5f82af8aa None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.054293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a067e-8307-4707-8016-aac5f82af8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.054633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a067e-8307-4707-8016-aac5f82af8aa None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.055536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a067e-8307-4707-8016-aac5f82af8aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:50.055980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a067e-8307-4707-8016-aac5f82af8aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.057511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a067e-8307-4707-8016-aac5f82af8aa None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.076606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.077870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 402/803] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 2 09:54:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:50.079133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793ab8b-3d01-4b75-b1cb-f9ba62d69260 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.079414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793ab8b-3d01-4b75-b1cb-f9ba62d69260 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.079710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793ab8b-3d01-4b75-b1cb-f9ba62d69260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.097133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b793ab8b-3d01-4b75-b1cb-f9ba62d69260 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:50.098349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b793ab8b-3d01-4b75-b1cb-f9ba62d69260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:50.136371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd9195-9295-4f4b-8d62-4231fa261ee8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.170368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 403/804] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:54:50.170554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43076a-430f-41ff-a509-185144c16123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.171298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43076a-430f-41ff-a509-185144c16123 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.171613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43076a-430f-41ff-a509-185144c16123 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.171888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43076a-430f-41ff-a509-185144c16123 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.172166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793ab8b-3d01-4b75-b1cb-f9ba62d69260 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.187091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43076a-430f-41ff-a509-185144c16123 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.188583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43076a-430f-41ff-a509-185144c16123 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-bc43076a-430f-41ff-a509-185144c16123 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:50.204546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:50.205988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:50.207568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:50.207568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:50.207568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:50.207568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:50.207568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:50.207568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:50.207568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:50.207568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:50.207568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 402/805] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:50.207568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43076a-430f-41ff-a509-185144c16123 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.228519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.282233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793ab8b-3d01-4b75-b1cb-f9ba62d69260 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.309320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43076a-430f-41ff-a509-185144c16123 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.316753 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac85f1-b5b9-403e-baf3-04b333bf3954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.317544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac85f1-b5b9-403e-baf3-04b333bf3954 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.317830 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac85f1-b5b9-403e-baf3-04b333bf3954 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.318112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac85f1-b5b9-403e-baf3-04b333bf3954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.318319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.328280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac85f1-b5b9-403e-baf3-04b333bf3954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.329812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac85f1-b5b9-403e-baf3-04b333bf3954 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.342789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c81d1-2f94-4a1c-ad36-b4e5996dd69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.343434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c81d1-2f94-4a1c-ad36-b4e5996dd69b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.343763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c81d1-2f94-4a1c-ad36-b4e5996dd69b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.344044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c81d1-2f94-4a1c-ad36-b4e5996dd69b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-aeac85f1-b5b9-403e-baf3-04b333bf3954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:50.348651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:50.349579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:50.350767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:50.350767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:50.350767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:50.350767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:50.350767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 404/806] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:50.351396 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e820e-132c-4567-8603-12546a06c1b8 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.351703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e820e-132c-4567-8603-12546a06c1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.351987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e820e-132c-4567-8603-12546a06c1b8 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.353249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 405/807] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:50.353935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e820e-132c-4567-8603-12546a06c1b8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.414089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c81d1-2f94-4a1c-ad36-b4e5996dd69b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.415545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c81d1-2f94-4a1c-ad36-b4e5996dd69b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.450202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.457296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e820e-132c-4567-8603-12546a06c1b8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.491171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e98f4b-3d10-4c87-bae3-9b6e01f9f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.491930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98f4b-3d10-4c87-bae3-9b6e01f9f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.492212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98f4b-3d10-4c87-bae3-9b6e01f9f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.492481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e98f4b-3d10-4c87-bae3-9b6e01f9f1d9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.493129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e98f4b-3d10-4c87-bae3-9b6e01f9f1d9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.494501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e98f4b-3d10-4c87-bae3-9b6e01f9f1d9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e5e98f4b-3d10-4c87-bae3-9b6e01f9f1d9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:50.507108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:50.508153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:50.509010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 406/808] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:50.510027 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e98f4b-3d10-4c87-bae3-9b6e01f9f1d9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.522440 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 403/809] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:54:50.522440 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c81d1-2f94-4a1c-ad36-b4e5996dd69b None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.529880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.611935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e98f4b-3d10-4c87-bae3-9b6e01f9f1d9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.618413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c81d1-2f94-4a1c-ad36-b4e5996dd69b None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.647967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3c4a6-9898-4903-b0a9-afaed86e7029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.648629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c4a6-9898-4903-b0a9-afaed86e7029 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.648920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c4a6-9898-4903-b0a9-afaed86e7029 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.649200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3c4a6-9898-4903-b0a9-afaed86e7029 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.649991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3c4a6-9898-4903-b0a9-afaed86e7029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:50.650379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3c4a6-9898-4903-b0a9-afaed86e7029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.652025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3c4a6-9898-4903-b0a9-afaed86e7029 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.653407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545df672-0f67-42f2-a605-3d106a612a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.654089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df672-0f67-42f2-a605-3d106a612a13 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.654379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df672-0f67-42f2-a605-3d106a612a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.654664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df672-0f67-42f2-a605-3d106a612a13 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.655384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545df672-0f67-42f2-a605-3d106a612a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:50.655725 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545df672-0f67-42f2-a605-3d106a612a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.657086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545df672-0f67-42f2-a605-3d106a612a13 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.664414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 407/810] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:50.665618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5265f-c183-4ac3-b0cb-28580d2339ea None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.665915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5265f-c183-4ac3-b0cb-28580d2339ea None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.666196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5265f-c183-4ac3-b0cb-28580d2339ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.669983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 404/811] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:50.670971 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545df672-0f67-42f2-a605-3d106a612a13 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.685732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-43d5265f-c183-4ac3-b0cb-28580d2339ea None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:50.686939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-43d5265f-c183-4ac3-b0cb-28580d2339ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:50.702033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.736225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.756122 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 408/812] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:54:50.756894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5265f-c183-4ac3-b0cb-28580d2339ea None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.788203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545df672-0f67-42f2-a605-3d106a612a13 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.822360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc0e8d-cacc-4531-96c5-7a0309659d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.823027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc0e8d-cacc-4531-96c5-7a0309659d28 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.823303 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc0e8d-cacc-4531-96c5-7a0309659d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.823608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc0e8d-cacc-4531-96c5-7a0309659d28 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.824311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc0e8d-cacc-4531-96c5-7a0309659d28 None admin] RBAC: Adding query filter params (name=network) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:50.824617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc0e8d-cacc-4531-96c5-7a0309659d28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.826050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc0e8d-cacc-4531-96c5-7a0309659d28 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.830376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 405/813] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:50.831107 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc0e8d-cacc-4531-96c5-7a0309659d28 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.854109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5265f-c183-4ac3-b0cb-28580d2339ea None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.888440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a9743-71fc-440b-9c1a-92954c93d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.889232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a9743-71fc-440b-9c1a-92954c93d694 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.889518 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a9743-71fc-440b-9c1a-92954c93d694 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.889797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a9743-71fc-440b-9c1a-92954c93d694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.901082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a9743-71fc-440b-9c1a-92954c93d694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.902617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a9743-71fc-440b-9c1a-92954c93d694 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-c59a9743-71fc-440b-9c1a-92954c93d694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:50.919811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:50.920698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:50.921626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:50.921626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:50.921626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:50.921626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:50.921626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 409/814] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:50.922083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a9743-71fc-440b-9c1a-92954c93d694 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:50.924582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.943358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc0e8d-cacc-4531-96c5-7a0309659d28 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:50.972342 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:50.976997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9703f-f242-454e-a700-b30a79e9065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:50.977875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9703f-f242-454e-a700-b30a79e9065c None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:50.978156 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9703f-f242-454e-a700-b30a79e9065c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:50.978433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9703f-f242-454e-a700-b30a79e9065c None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/386b93ddf5434625850806abb77b4b7d/roles/441d11583e0f484885b1f24b8eeb28dd` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:50.992999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9703f-f242-454e-a700-b30a79e9065c None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=386b93ddf5434625850806abb77b4b7d, role_id=441d11583e0f484885b1f24b8eeb28dd)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:50.994477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9703f-f242-454e-a700-b30a79e9065c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.022933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a9743-71fc-440b-9c1a-92954c93d694 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.055705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f4d93-f2f1-4a46-b09d-6c1e741d1153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.056482 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f4d93-f2f1-4a46-b09d-6c1e741d1153 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.056797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f4d93-f2f1-4a46-b09d-6c1e741d1153 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.057078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f4d93-f2f1-4a46-b09d-6c1e741d1153 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.064330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 406/815] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:50 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/386b93ddf5434625850806abb77b4b7d/roles/441d11583e0f484885b1f24b8eeb28dd => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:54:51.065154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9703f-f242-454e-a700-b30a79e9065c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.065613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f4d93-f2f1-4a46-b09d-6c1e741d1153 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.068159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f4d93-f2f1-4a46-b09d-6c1e741d1153 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2c5f4d93-f2f1-4a46-b09d-6c1e741d1153 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:51.083886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:51.086188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:51.087345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:51.087345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:51.087345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:51.087345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:51.087345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:51.087345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:51.087345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:51.087345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:51.087345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:51.087345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:51.088809 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 410/816] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:51.089867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f4d93-f2f1-4a46-b09d-6c1e741d1153 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.163102 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.192166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9703f-f242-454e-a700-b30a79e9065c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.208960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f4d93-f2f1-4a46-b09d-6c1e741d1153 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.230209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afd9e5-b78c-4cf9-b99e-0a40003d47c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.231696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afd9e5-b78c-4cf9-b99e-0a40003d47c4 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.232186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afd9e5-b78c-4cf9-b99e-0a40003d47c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.232615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afd9e5-b78c-4cf9-b99e-0a40003d47c4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.233445 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afd9e5-b78c-4cf9-b99e-0a40003d47c4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.235151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afd9e5-b78c-4cf9-b99e-0a40003d47c4 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.246885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947ffb6-b55f-4902-92dc-1ae31c1a3de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.247569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947ffb6-b55f-4902-92dc-1ae31c1a3de8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.247884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947ffb6-b55f-4902-92dc-1ae31c1a3de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.248168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947ffb6-b55f-4902-92dc-1ae31c1a3de8 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.248897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947ffb6-b55f-4902-92dc-1ae31c1a3de8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:51.249212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947ffb6-b55f-4902-92dc-1ae31c1a3de8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-76afd9e5-b78c-4cf9-b99e-0a40003d47c4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:51.250364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:51.251462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 09:54:51.252526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:51.253725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947ffb6-b55f-4902-92dc-1ae31c1a3de8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.255354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 407/817] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:51.256195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afd9e5-b78c-4cf9-b99e-0a40003d47c4 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.258392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 411/818] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:51.259291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947ffb6-b55f-4902-92dc-1ae31c1a3de8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.313276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.374389 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947ffb6-b55f-4902-92dc-1ae31c1a3de8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.379680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afd9e5-b78c-4cf9-b99e-0a40003d47c4 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.400740 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.410152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058d6a-23b3-40b8-a9c0-700831549fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.410902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058d6a-23b3-40b8-a9c0-700831549fcd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.411187 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058d6a-23b3-40b8-a9c0-700831549fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.411468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058d6a-23b3-40b8-a9c0-700831549fcd None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.412353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058d6a-23b3-40b8-a9c0-700831549fcd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:51.412674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058d6a-23b3-40b8-a9c0-700831549fcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.414098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058d6a-23b3-40b8-a9c0-700831549fcd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.417651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c20c1-6b87-406c-bdbf-8fd95f74ec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.418314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c20c1-6b87-406c-bdbf-8fd95f74ec69 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.418595 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c20c1-6b87-406c-bdbf-8fd95f74ec69 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.418871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c20c1-6b87-406c-bdbf-8fd95f74ec69 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.419611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c20c1-6b87-406c-bdbf-8fd95f74ec69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:51.419928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c20c1-6b87-406c-bdbf-8fd95f74ec69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.421287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c20c1-6b87-406c-bdbf-8fd95f74ec69 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.432328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 412/819] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:51.433164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058d6a-23b3-40b8-a9c0-700831549fcd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.439619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 408/820] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:51.440806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c20c1-6b87-406c-bdbf-8fd95f74ec69 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.542554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058d6a-23b3-40b8-a9c0-700831549fcd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.548677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c20c1-6b87-406c-bdbf-8fd95f74ec69 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.557079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.583399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de6259-9e2d-43dd-aec3-a56c9a4d1d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.584089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de6259-9e2d-43dd-aec3-a56c9a4d1d1a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.584372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de6259-9e2d-43dd-aec3-a56c9a4d1d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.584650 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de6259-9e2d-43dd-aec3-a56c9a4d1d1a None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.585359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de6259-9e2d-43dd-aec3-a56c9a4d1d1a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:51.585667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de6259-9e2d-43dd-aec3-a56c9a4d1d1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.585769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd292f1-2c0e-48f9-948b-aecb7140e353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.586345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd292f1-2c0e-48f9-948b-aecb7140e353 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.586632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd292f1-2c0e-48f9-948b-aecb7140e353 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.586911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd292f1-2c0e-48f9-948b-aecb7140e353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.587004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de6259-9e2d-43dd-aec3-a56c9a4d1d1a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.587678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd292f1-2c0e-48f9-948b-aecb7140e353 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.589077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd292f1-2c0e-48f9-948b-aecb7140e353 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.592717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 413/821] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:51.594142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de6259-9e2d-43dd-aec3-a56c9a4d1d1a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.645113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.694110 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de6259-9e2d-43dd-aec3-a56c9a4d1d1a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.711611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 409/822] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 2 09:54:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:51.711611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd292f1-2c0e-48f9-948b-aecb7140e353 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.751182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d8312-e1ed-4e99-9647-826af7e20c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.752112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d8312-e1ed-4e99-9647-826af7e20c61 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.752468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d8312-e1ed-4e99-9647-826af7e20c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.752920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d8312-e1ed-4e99-9647-826af7e20c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.765065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d8312-e1ed-4e99-9647-826af7e20c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.766763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d8312-e1ed-4e99-9647-826af7e20c61 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-c12d8312-e1ed-4e99-9647-826af7e20c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:51.788617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:51.789591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:51.790488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:51.790488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:51.790488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:51.790488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:51.790488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 414/823] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:51.790936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d8312-e1ed-4e99-9647-826af7e20c61 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.855692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd292f1-2c0e-48f9-948b-aecb7140e353 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.909752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad96fb-f0d8-4175-9659-1b46b5a19b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.910578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad96fb-f0d8-4175-9659-1b46b5a19b95 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.910865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad96fb-f0d8-4175-9659-1b46b5a19b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.911214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad96fb-f0d8-4175-9659-1b46b5a19b95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.920764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.922520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad96fb-f0d8-4175-9659-1b46b5a19b95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.924227 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad96fb-f0d8-4175-9659-1b46b5a19b95 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.928572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d8312-e1ed-4e99-9647-826af7e20c61 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-bcad96fb-f0d8-4175-9659-1b46b5a19b95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:51.945530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:51.954654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:51.955567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:51.955567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:51.955567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:51.955567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:51.955567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:51.955567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:51.955567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:51.955567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:51.955567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 410/824] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:51.955567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad96fb-f0d8-4175-9659-1b46b5a19b95 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:51.975171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3776f2e-663f-4392-a13b-804e9b5fedaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:51.975874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3776f2e-663f-4392-a13b-804e9b5fedaa None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:51.976173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3776f2e-663f-4392-a13b-804e9b5fedaa None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:51.976433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3776f2e-663f-4392-a13b-804e9b5fedaa None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:51.977147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3776f2e-663f-4392-a13b-804e9b5fedaa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:51.977455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3776f2e-663f-4392-a13b-804e9b5fedaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:51.978834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3776f2e-663f-4392-a13b-804e9b5fedaa None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:51.983910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:51.984164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 415/825] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:51.985013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3776f2e-663f-4392-a13b-804e9b5fedaa None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:52.079700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad96fb-f0d8-4175-9659-1b46b5a19b95 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.104263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3776f2e-663f-4392-a13b-804e9b5fedaa None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.116649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91f0e-78b7-4942-905d-de829bbdc2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.117246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91f0e-78b7-4942-905d-de829bbdc2ff None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.117533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91f0e-78b7-4942-905d-de829bbdc2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.117818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d91f0e-78b7-4942-905d-de829bbdc2ff None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.118539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d91f0e-78b7-4942-905d-de829bbdc2ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:52.118848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d91f0e-78b7-4942-905d-de829bbdc2ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.120383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d91f0e-78b7-4942-905d-de829bbdc2ff None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.134972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 411/826] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:52.135811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91f0e-78b7-4942-905d-de829bbdc2ff None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:52.149682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ccc22-5248-45f0-b5b5-a2c5ebe30ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.150347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ccc22-5248-45f0-b5b5-a2c5ebe30ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.150886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ccc22-5248-45f0-b5b5-a2c5ebe30ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.151169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ccc22-5248-45f0-b5b5-a2c5ebe30ad3 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.151992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ccc22-5248-45f0-b5b5-a2c5ebe30ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:52.152310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ccc22-5248-45f0-b5b5-a2c5ebe30ad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.153753 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ccc22-5248-45f0-b5b5-a2c5ebe30ad3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.165374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 416/827] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:52.166164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ccc22-5248-45f0-b5b5-a2c5ebe30ad3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:52.189767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:52.236957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:52.259794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d91f0e-78b7-4942-905d-de829bbdc2ff None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.272135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ccc22-5248-45f0-b5b5-a2c5ebe30ad3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.302607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c262dc-25a3-4736-87eb-1eb636cd58b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.303274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c262dc-25a3-4736-87eb-1eb636cd58b1 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.303565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c262dc-25a3-4736-87eb-1eb636cd58b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.303869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c262dc-25a3-4736-87eb-1eb636cd58b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.304614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c262dc-25a3-4736-87eb-1eb636cd58b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.305975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c262dc-25a3-4736-87eb-1eb636cd58b1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.309008 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f9a8d-5aa9-49c4-8925-58333b056b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.309797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9a8d-5aa9-49c4-8925-58333b056b33 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.310084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9a8d-5aa9-49c4-8925-58333b056b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.310484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f9a8d-5aa9-49c4-8925-58333b056b33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.317806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f9a8d-5aa9-49c4-8925-58333b056b33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.319237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f9a8d-5aa9-49c4-8925-58333b056b33 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-575f9a8d-5aa9-49c4-8925-58333b056b33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:52.334395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:52.335390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:52.336334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:52.336334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:52.336334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:52.336334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:52.336334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:52.336334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:52.336334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:52.336334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:52.336334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 417/828] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:52.336830 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f9a8d-5aa9-49c4-8925-58333b056b33 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:52.406118 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 412/829] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 2 09:54:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:52.407319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c262dc-25a3-4736-87eb-1eb636cd58b1 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:52.434993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:52.464580 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f9a8d-5aa9-49c4-8925-58333b056b33 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.517663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c54ae-5976-4deb-942b-e103647585ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.518377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c54ae-5976-4deb-942b-e103647585ae None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.518671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c54ae-5976-4deb-942b-e103647585ae None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.519724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c54ae-5976-4deb-942b-e103647585ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.521247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c54ae-5976-4deb-942b-e103647585ae None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=ba690590103a4019a56b191e8dfe3231) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:52.521572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c54ae-5976-4deb-942b-e103647585ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.523564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c54ae-5976-4deb-942b-e103647585ae None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.535770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 418/830] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:52 2022] GET /identity/v3/role_assignments?user.id=ba690590103a4019a56b191e8dfe3231&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=918b179f19b6437493eabe5394fa9af0 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:52.559943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c262dc-25a3-4736-87eb-1eb636cd58b1 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.601017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235fb5a-35ae-47a1-b9fe-c2278353daaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.602117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235fb5a-35ae-47a1-b9fe-c2278353daaa None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.602609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235fb5a-35ae-47a1-b9fe-c2278353daaa None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.603084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235fb5a-35ae-47a1-b9fe-c2278353daaa None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.604221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235fb5a-35ae-47a1-b9fe-c2278353daaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:52.604757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235fb5a-35ae-47a1-b9fe-c2278353daaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.606503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235fb5a-35ae-47a1-b9fe-c2278353daaa None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.616722 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:52.624206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 413/831] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:52.630007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c54ae-5976-4deb-942b-e103647585ae None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:52.748687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c54ae-5976-4deb-942b-e103647585ae None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:52.785593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aede08-b399-4b31-91f1-18f410ded82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:52.786829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aede08-b399-4b31-91f1-18f410ded82b None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:52.787347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aede08-b399-4b31-91f1-18f410ded82b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:52.787870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aede08-b399-4b31-91f1-18f410ded82b None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/842ffae8f3b04107b994e57bc880b59b/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:52.790108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aede08-b399-4b31-91f1-18f410ded82b None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=842ffae8f3b04107b994e57bc880b59b, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:52.791784 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aede08-b399-4b31-91f1-18f410ded82b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:52.858448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:52.865313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 419/832] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:54:52 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/842ffae8f3b04107b994e57bc880b59b/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 09:54:53.397800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d2e7e-cb16-499d-bfc9-214a945e51ce None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:53.398415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d2e7e-cb16-499d-bfc9-214a945e51ce None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:53.398415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d2e7e-cb16-499d-bfc9-214a945e51ce None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:53.400042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 414/833] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:53.405861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280b2d3-d2d9-40cb-9861-18306e12c86b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:53.406160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280b2d3-d2d9-40cb-9861-18306e12c86b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:53.406446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280b2d3-d2d9-40cb-9861-18306e12c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:53.423543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8280b2d3-d2d9-40cb-9861-18306e12c86b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:53.424754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8280b2d3-d2d9-40cb-9861-18306e12c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:53.493716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 420/834] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:54:53.517533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d2e7e-cb16-499d-bfc9-214a945e51ce None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:53.631597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d2e7e-cb16-499d-bfc9-214a945e51ce None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:53.668726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a4676-f438-4de0-a6cd-e7550c2b2d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:53.669479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a4676-f438-4de0-a6cd-e7550c2b2d40 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:53.669770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a4676-f438-4de0-a6cd-e7550c2b2d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:53.670041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a4676-f438-4de0-a6cd-e7550c2b2d40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:53.681649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a4676-f438-4de0-a6cd-e7550c2b2d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-811a4676-f438-4de0-a6cd-e7550c2b2d40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:53.689841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:53.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:53.693848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 415/835] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:54:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:53.697879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280b2d3-d2d9-40cb-9861-18306e12c86b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:53.809325 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280b2d3-d2d9-40cb-9861-18306e12c86b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:53.839253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:53.845059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59ce99-a599-403a-a19e-f5e8d048a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:53.845733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59ce99-a599-403a-a19e-f5e8d048a9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:53.846022 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59ce99-a599-403a-a19e-f5e8d048a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:53.846306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59ce99-a599-403a-a19e-f5e8d048a9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:53.847748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59ce99-a599-403a-a19e-f5e8d048a9c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:53.848157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59ce99-a599-403a-a19e-f5e8d048a9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:53.849564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59ce99-a599-403a-a19e-f5e8d048a9c8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:53.858454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 421/836] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:54:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:53.875547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a4676-f438-4de0-a6cd-e7550c2b2d40 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:53.934740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:53.978110 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a4676-f438-4de0-a6cd-e7550c2b2d40 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:54.013401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef060-d2a8-45b3-b403-8dd1fcd4f196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:54.014254 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef060-d2a8-45b3-b403-8dd1fcd4f196 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.014541 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef060-d2a8-45b3-b403-8dd1fcd4f196 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.014866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ef060-d2a8-45b3-b403-8dd1fcd4f196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.027717 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ef060-d2a8-45b3-b403-8dd1fcd4f196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:54.029301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ef060-d2a8-45b3-b403-8dd1fcd4f196 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-e10ef060-d2a8-45b3-b403-8dd1fcd4f196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:54.047702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:54.048669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:54.049567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:54.049567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:54.049567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:54.049567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:54.049567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 416/837] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:54.055732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59ce99-a599-403a-a19e-f5e8d048a9c8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:54.163065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59ce99-a599-403a-a19e-f5e8d048a9c8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:54.199265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dde01-0aa4-4c88-bfd9-20219b690887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:54.199880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dde01-0aa4-4c88-bfd9-20219b690887 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.200168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dde01-0aa4-4c88-bfd9-20219b690887 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.200448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dde01-0aa4-4c88-bfd9-20219b690887 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.201190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dde01-0aa4-4c88-bfd9-20219b690887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:54.201503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dde01-0aa4-4c88-bfd9-20219b690887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:54.202881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dde01-0aa4-4c88-bfd9-20219b690887 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:54.219696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 422/838] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:54.221252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef060-d2a8-45b3-b403-8dd1fcd4f196 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:54.326114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ef060-d2a8-45b3-b403-8dd1fcd4f196 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:54.337942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:54.361447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db35f1-3c24-403c-8d20-fcf22e586df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:54.362317 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db35f1-3c24-403c-8d20-fcf22e586df3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.362821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db35f1-3c24-403c-8d20-fcf22e586df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.363450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db35f1-3c24-403c-8d20-fcf22e586df3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.371633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db35f1-3c24-403c-8d20-fcf22e586df3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:54.373337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db35f1-3c24-403c-8d20-fcf22e586df3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-d6db35f1-3c24-403c-8d20-fcf22e586df3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:54.389479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:54.391709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:54.394080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:54.394080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:54.394080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:54.394080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:54.394080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:54.394080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:54.394080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:54.394080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:54.394080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:54:54.394080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:54.399627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 417/839] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 2 09:54:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:54.401673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dde01-0aa4-4c88-bfd9-20219b690887 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:54.461214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:54.513748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dde01-0aa4-4c88-bfd9-20219b690887 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:54.550906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d07911-1d1d-4d7f-aefb-0a67d94403fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:54.551603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07911-1d1d-4d7f-aefb-0a67d94403fa None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.551904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07911-1d1d-4d7f-aefb-0a67d94403fa None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.552181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d07911-1d1d-4d7f-aefb-0a67d94403fa None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.553031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d07911-1d1d-4d7f-aefb-0a67d94403fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:54.553347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d07911-1d1d-4d7f-aefb-0a67d94403fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:54.554787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d07911-1d1d-4d7f-aefb-0a67d94403fa None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:54.578553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 423/840] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 2 09:54:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:54.579914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db35f1-3c24-403c-8d20-fcf22e586df3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:54.690289 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db35f1-3c24-403c-8d20-fcf22e586df3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:54.725904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d831980-581b-4bd2-9e7b-3689c8c07c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:54.726483 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d831980-581b-4bd2-9e7b-3689c8c07c86 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.726773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d831980-581b-4bd2-9e7b-3689c8c07c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.727055 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d831980-581b-4bd2-9e7b-3689c8c07c86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.767894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:54.801305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d831980-581b-4bd2-9e7b-3689c8c07c86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:54.803124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d831980-581b-4bd2-9e7b-3689c8c07c86 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:54.804050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901212a-7e0b-4a33-80b8-424945d1aafa None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.804506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901212a-7e0b-4a33-80b8-424945d1aafa None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.804586 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901212a-7e0b-4a33-80b8-424945d1aafa None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.806214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 424/841] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:54.811379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217e43-f264-460f-b1bf-0efa8eabe610 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:54.811720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217e43-f264-460f-b1bf-0efa8eabe610 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:54.812005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac217e43-f264-460f-b1bf-0efa8eabe610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:54.831123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ac217e43-f264-460f-b1bf-0efa8eabe610 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:54.833016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ac217e43-f264-460f-b1bf-0efa8eabe610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:54.935618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 425/842] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:54:54.937600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 418/843] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:54:54.944721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac217e43-f264-460f-b1bf-0efa8eabe610 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:54.958038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d831980-581b-4bd2-9e7b-3689c8c07c86 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.012768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.036430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.070511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d831980-581b-4bd2-9e7b-3689c8c07c86 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.071001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac217e43-f264-460f-b1bf-0efa8eabe610 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.106793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947376f-b132-4f0c-bdf8-d06331eead1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.107016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e821c-1d04-4321-af27-a4cbcd780f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.107605 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947376f-b132-4f0c-bdf8-d06331eead1f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.107749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e821c-1d04-4321-af27-a4cbcd780f18 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.107935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e821c-1d04-4321-af27-a4cbcd780f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.108032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947376f-b132-4f0c-bdf8-d06331eead1f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.108182 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e821c-1d04-4321-af27-a4cbcd780f18 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.108274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947376f-b132-4f0c-bdf8-d06331eead1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.108982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e821c-1d04-4321-af27-a4cbcd780f18 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.110472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e821c-1d04-4321-af27-a4cbcd780f18 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.118917 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947376f-b132-4f0c-bdf8-d06331eead1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.120444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947376f-b132-4f0c-bdf8-d06331eead1f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-a39e821c-1d04-4321-af27-a4cbcd780f18 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:55.123164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:55.124224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:54:55.125103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:55.129425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 419/844] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:54:55.130224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb2b5e-22c7-4f2d-ab0d-82b2ac49566a None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.130517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb2b5e-22c7-4f2d-ab0d-82b2ac49566a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.130798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb2b5e-22c7-4f2d-ab0d-82b2ac49566a None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.132278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 420/845] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:55.132904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb2b5e-22c7-4f2d-ab0d-82b2ac49566a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-a947376f-b132-4f0c-bdf8-d06331eead1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:55.147953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:55.148946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:55.149882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:55.149882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:55.149882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:55.149882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:55.152004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 426/846] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:55.153862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7761f5-674f-43a9-954c-a32209fba21b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.154752 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7761f5-674f-43a9-954c-a32209fba21b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.155043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7761f5-674f-43a9-954c-a32209fba21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.173199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-cf7761f5-674f-43a9-954c-a32209fba21b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:55.174420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cf7761f5-674f-43a9-954c-a32209fba21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:55.244686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 427/847] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:54:55.245091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb2b5e-22c7-4f2d-ab0d-82b2ac49566a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.245557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7761f5-674f-43a9-954c-a32209fba21b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.270436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.295607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ec12e-ec2f-4f6b-9d3a-b6a0c9d91561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.296292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec12e-ec2f-4f6b-9d3a-b6a0c9d91561 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.296674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec12e-ec2f-4f6b-9d3a-b6a0c9d91561 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.296847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec12e-ec2f-4f6b-9d3a-b6a0c9d91561 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.297569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ec12e-ec2f-4f6b-9d3a-b6a0c9d91561 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:55.297880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ec12e-ec2f-4f6b-9d3a-b6a0c9d91561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.299257 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ec12e-ec2f-4f6b-9d3a-b6a0c9d91561 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.301313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.305924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 421/848] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:55.306766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ec12e-ec2f-4f6b-9d3a-b6a0c9d91561 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.349630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7761f5-674f-43a9-954c-a32209fba21b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.383989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7a193-64de-42c1-964a-46ef88d6731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.384731 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7a193-64de-42c1-964a-46ef88d6731c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.385018 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7a193-64de-42c1-964a-46ef88d6731c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.385300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7a193-64de-42c1-964a-46ef88d6731c None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.386019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7a193-64de-42c1-964a-46ef88d6731c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:55.386330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7a193-64de-42c1-964a-46ef88d6731c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.387742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7a193-64de-42c1-964a-46ef88d6731c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.399190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 428/849] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:55.400706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff2baf-bad6-4861-b06e-ef14aa579e76 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.401006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff2baf-bad6-4861-b06e-ef14aa579e76 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.401290 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff2baf-bad6-4861-b06e-ef14aa579e76 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.402512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 429/850] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:55.403207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff2baf-bad6-4861-b06e-ef14aa579e76 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.412046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ec12e-ec2f-4f6b-9d3a-b6a0c9d91561 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.445887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1c8ae-cf41-46be-98e3-b7afed75e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.446705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1c8ae-cf41-46be-98e3-b7afed75e14f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.446994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1c8ae-cf41-46be-98e3-b7afed75e14f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.447274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1c8ae-cf41-46be-98e3-b7afed75e14f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.447958 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1c8ae-cf41-46be-98e3-b7afed75e14f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.449330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1c8ae-cf41-46be-98e3-b7afed75e14f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-1cf1c8ae-cf41-46be-98e3-b7afed75e14f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:55.462070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:55.463011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:55.464063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 422/851] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:55.464946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5e58b-5528-41a8-bf1d-6f33873f3411 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.465140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5e58b-5528-41a8-bf1d-6f33873f3411 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.465422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5e58b-5528-41a8-bf1d-6f33873f3411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.481476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7bb5e58b-5528-41a8-bf1d-6f33873f3411 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:55.482663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7bb5e58b-5528-41a8-bf1d-6f33873f3411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:55.487069 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.506526 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff2baf-bad6-4861-b06e-ef14aa579e76 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.540539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.541668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab6d61-95c7-43da-b799-3798ada9df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.542319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab6d61-95c7-43da-b799-3798ada9df0f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.542600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab6d61-95c7-43da-b799-3798ada9df0f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.542874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab6d61-95c7-43da-b799-3798ada9df0f None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.543574 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab6d61-95c7-43da-b799-3798ada9df0f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:55.543912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab6d61-95c7-43da-b799-3798ada9df0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.545267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab6d61-95c7-43da-b799-3798ada9df0f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.549616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 430/852] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:55.550526 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab6d61-95c7-43da-b799-3798ada9df0f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.550999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 423/853] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:54:55.551850 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5e58b-5528-41a8-bf1d-6f33873f3411 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.670127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5e58b-5528-41a8-bf1d-6f33873f3411 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.673409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab6d61-95c7-43da-b799-3798ada9df0f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.710637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580deaad-5bd3-456b-8ead-f008386b1190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.710900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf163bc-4687-4d23-a330-c2b22f6fe2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.711547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf163bc-4687-4d23-a330-c2b22f6fe2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.711861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf163bc-4687-4d23-a330-c2b22f6fe2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.712108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580deaad-5bd3-456b-8ead-f008386b1190 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.712222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf163bc-4687-4d23-a330-c2b22f6fe2d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.712645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580deaad-5bd3-456b-8ead-f008386b1190 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.713144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580deaad-5bd3-456b-8ead-f008386b1190 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.714185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580deaad-5bd3-456b-8ead-f008386b1190 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:55.714507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580deaad-5bd3-456b-8ead-f008386b1190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.716049 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580deaad-5bd3-456b-8ead-f008386b1190 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.719705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf163bc-4687-4d23-a330-c2b22f6fe2d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.721168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf163bc-4687-4d23-a330-c2b22f6fe2d4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.726922 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 424/854] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:55.728040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580deaad-5bd3-456b-8ead-f008386b1190 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-7bf163bc-4687-4d23-a330-c2b22f6fe2d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:55.736863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:55.738093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:55.739176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:55.739176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:55.739176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:55.739176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:55.739176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:55.739176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:55.739176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:55.739176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:55.739176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 431/855] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:55.739766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf163bc-4687-4d23-a330-c2b22f6fe2d4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.752584 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.796428 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:55.840493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580deaad-5bd3-456b-8ead-f008386b1190 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.855183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf163bc-4687-4d23-a330-c2b22f6fe2d4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:55.893505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23669415-f306-44c3-a18f-94b1eb37919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.894805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669415-f306-44c3-a18f-94b1eb37919d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.895131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669415-f306-44c3-a18f-94b1eb37919d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.895442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23669415-f306-44c3-a18f-94b1eb37919d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.896967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9062e39-875b-4100-afae-2c014aa21250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:55.897889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9062e39-875b-4100-afae-2c014aa21250 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:55.898478 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9062e39-875b-4100-afae-2c014aa21250 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:55.898764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9062e39-875b-4100-afae-2c014aa21250 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:55.899484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9062e39-875b-4100-afae-2c014aa21250 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:55.899832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9062e39-875b-4100-afae-2c014aa21250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:55.901763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9062e39-875b-4100-afae-2c014aa21250 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:55.906230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23669415-f306-44c3-a18f-94b1eb37919d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:55.915901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 432/856] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:55.915901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9062e39-875b-4100-afae-2c014aa21250 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-23669415-f306-44c3-a18f-94b1eb37919d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:55.916192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:55.917089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:55.917943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 425/857] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:55.922046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23669415-f306-44c3-a18f-94b1eb37919d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.022758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.038759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23669415-f306-44c3-a18f-94b1eb37919d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.058622 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.072904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9062e39-875b-4100-afae-2c014aa21250 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.079822 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e0f60-539d-4529-856c-55222abfa4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.080773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0f60-539d-4529-856c-55222abfa4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.081269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0f60-539d-4529-856c-55222abfa4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.081852 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e0f60-539d-4529-856c-55222abfa4f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.083062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e0f60-539d-4529-856c-55222abfa4f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:56.083476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e0f60-539d-4529-856c-55222abfa4f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.085206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e0f60-539d-4529-856c-55222abfa4f0 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.100599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 426/858] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:54:56.102016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e0f60-539d-4529-856c-55222abfa4f0 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.121321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6d928-b16e-43aa-abd4-59d8c03498f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.121997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d928-b16e-43aa-abd4-59d8c03498f1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.122290 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d928-b16e-43aa-abd4-59d8c03498f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.122556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6d928-b16e-43aa-abd4-59d8c03498f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.123637 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6d928-b16e-43aa-abd4-59d8c03498f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:56.123751 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6d928-b16e-43aa-abd4-59d8c03498f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.125324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6d928-b16e-43aa-abd4-59d8c03498f1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.138895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 433/859] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:56.145385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6d928-b16e-43aa-abd4-59d8c03498f1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.230590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e0f60-539d-4529-856c-55222abfa4f0 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.273054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e04dd-5bb7-4d06-93e3-dd9094373785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.273371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6d928-b16e-43aa-abd4-59d8c03498f1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.274097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e04dd-5bb7-4d06-93e3-dd9094373785 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.274497 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e04dd-5bb7-4d06-93e3-dd9094373785 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.274868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e04dd-5bb7-4d06-93e3-dd9094373785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.290503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e04dd-5bb7-4d06-93e3-dd9094373785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.292824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e04dd-5bb7-4d06-93e3-dd9094373785 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.307311 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.313744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f877d7-4878-4a33-b699-29f81a6cdb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.314771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f877d7-4878-4a33-b699-29f81a6cdb43 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.315207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f877d7-4878-4a33-b699-29f81a6cdb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.315862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f877d7-4878-4a33-b699-29f81a6cdb43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.317433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f877d7-4878-4a33-b699-29f81a6cdb43 None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=386b93ddf5434625850806abb77b4b7d) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-0e3e04dd-5bb7-4d06-93e3-dd9094373785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:56.324674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:56.325550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:56.326461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:56.326461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:56.326461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:56.326461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:56.326687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f877d7-4878-4a33-b699-29f81a6cdb43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.326757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 427/860] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:56.326857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f877d7-4878-4a33-b699-29f81a6cdb43 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.328952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e04dd-5bb7-4d06-93e3-dd9094373785 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.333755 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 434/861] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/role_assignments?user.id=386b93ddf5434625850806abb77b4b7d&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:56.374684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.458832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e04dd-5bb7-4d06-93e3-dd9094373785 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.500031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7374ba-c4cf-4d84-a761-3f969af252a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.501033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7374ba-c4cf-4d84-a761-3f969af252a3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.501502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7374ba-c4cf-4d84-a761-3f969af252a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.501986 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7374ba-c4cf-4d84-a761-3f969af252a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.502942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7374ba-c4cf-4d84-a761-3f969af252a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:56.503695 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7374ba-c4cf-4d84-a761-3f969af252a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.505402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7374ba-c4cf-4d84-a761-3f969af252a3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.520270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 428/862] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:56.526459 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f877d7-4878-4a33-b699-29f81a6cdb43 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.638255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f877d7-4878-4a33-b699-29f81a6cdb43 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.676773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8cc0-7f38-48b7-97a2-65bc33b44130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.677932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8cc0-7f38-48b7-97a2-65bc33b44130 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.678461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8cc0-7f38-48b7-97a2-65bc33b44130 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.678952 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca8cc0-7f38-48b7-97a2-65bc33b44130 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.688977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca8cc0-7f38-48b7-97a2-65bc33b44130 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.690745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca8cc0-7f38-48b7-97a2-65bc33b44130 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-50ca8cc0-7f38-48b7-97a2-65bc33b44130 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:56.705923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:56.706979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:56.708014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:56.708014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:56.708014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:56.708014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:56.708014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:56.708014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:56.708014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:56.708014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:56.708014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 09:54:56.708014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:56.710341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 435/863] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:56.716380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7374ba-c4cf-4d84-a761-3f969af252a3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.817047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:56.827643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7374ba-c4cf-4d84-a761-3f969af252a3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:56.863196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704ee5f-b58f-4278-b1e6-2a3450fcc3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:56.864160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704ee5f-b58f-4278-b1e6-2a3450fcc3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:56.864618 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704ee5f-b58f-4278-b1e6-2a3450fcc3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:56.865220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704ee5f-b58f-4278-b1e6-2a3450fcc3d1 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:56.866206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704ee5f-b58f-4278-b1e6-2a3450fcc3d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:56.866651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704ee5f-b58f-4278-b1e6-2a3450fcc3d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:56.868303 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704ee5f-b58f-4278-b1e6-2a3450fcc3d1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:56.890297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 429/864] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:56.896337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8cc0-7f38-48b7-97a2-65bc33b44130 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:56.953967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:57.007039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca8cc0-7f38-48b7-97a2-65bc33b44130 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.042686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87347ecc-379e-432a-b17a-cd2bbfafa7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.043573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347ecc-379e-432a-b17a-cd2bbfafa7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.044059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347ecc-379e-432a-b17a-cd2bbfafa7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.044489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87347ecc-379e-432a-b17a-cd2bbfafa7a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.117239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87347ecc-379e-432a-b17a-cd2bbfafa7a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.119045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87347ecc-379e-432a-b17a-cd2bbfafa7a4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.177432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:57.224812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 436/865] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:54:57.230654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704ee5f-b58f-4278-b1e6-2a3450fcc3d1 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.337899 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704ee5f-b58f-4278-b1e6-2a3450fcc3d1 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.373329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6147d-5714-4d0b-b710-dee47580c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.374475 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6147d-5714-4d0b-b710-dee47580c84e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.374981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6147d-5714-4d0b-b710-dee47580c84e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.375461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6147d-5714-4d0b-b710-dee47580c84e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.387342 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6147d-5714-4d0b-b710-dee47580c84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.389092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6147d-5714-4d0b-b710-dee47580c84e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.398631 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-9ac6147d-5714-4d0b-b710-dee47580c84e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:57.409585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:57.416537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:57.417456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:57.417456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:57.417456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:57.417456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:57.417456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 430/866] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:57.417734 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87347ecc-379e-432a-b17a-cd2bbfafa7a4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.518213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87347ecc-379e-432a-b17a-cd2bbfafa7a4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.555316 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c802f0-8cb9-4bf5-a114-893eaf0d2805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.556033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c802f0-8cb9-4bf5-a114-893eaf0d2805 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.556315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c802f0-8cb9-4bf5-a114-893eaf0d2805 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.556590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c802f0-8cb9-4bf5-a114-893eaf0d2805 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.557335 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c802f0-8cb9-4bf5-a114-893eaf0d2805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:57.557645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c802f0-8cb9-4bf5-a114-893eaf0d2805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.559084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c802f0-8cb9-4bf5-a114-893eaf0d2805 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.572738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 437/867] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:57.578432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6147d-5714-4d0b-b710-dee47580c84e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.688978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6147d-5714-4d0b-b710-dee47580c84e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.726914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0ebc9-f069-4b66-a9b8-997867a08090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.728116 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0ebc9-f069-4b66-a9b8-997867a08090 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.728609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0ebc9-f069-4b66-a9b8-997867a08090 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.729108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0ebc9-f069-4b66-a9b8-997867a08090 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.736576 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0ebc9-f069-4b66-a9b8-997867a08090 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.738711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0ebc9-f069-4b66-a9b8-997867a08090 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-12b0ebc9-f069-4b66-a9b8-997867a08090 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:54:57.753192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:57.754236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:57.755146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:54:57.755146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:54:57.755146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:54:57.755146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:54:57.755146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:54:57.755146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:54:57.755146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:54:57.755146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:54:57.757658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 431/868] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:57.763509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c802f0-8cb9-4bf5-a114-893eaf0d2805 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.781642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:57.870818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c802f0-8cb9-4bf5-a114-893eaf0d2805 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:57.905560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98eac7-fb48-42d0-bdd4-8d8602764031 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.905908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98eac7-fb48-42d0-bdd4-8d8602764031 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.906029 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d7cec-fcdc-4d2c-b71f-af29345a74d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:57.906451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98eac7-fb48-42d0-bdd4-8d8602764031 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.906656 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d7cec-fcdc-4d2c-b71f-af29345a74d7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.906878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d7cec-fcdc-4d2c-b71f-af29345a74d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.907154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d7cec-fcdc-4d2c-b71f-af29345a74d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.907970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d7cec-fcdc-4d2c-b71f-af29345a74d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:57.908280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d7cec-fcdc-4d2c-b71f-af29345a74d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:57.910408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d7cec-fcdc-4d2c-b71f-af29345a74d7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:57.911807 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 432/869] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:57.913467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353b608-5e10-487f-a693-8e3493152b1d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:57.913867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353b608-5e10-487f-a693-8e3493152b1d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:57.914257 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353b608-5e10-487f-a693-8e3493152b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:57.923735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 438/870] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:57.932246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-1353b608-5e10-487f-a693-8e3493152b1d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:57.932761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d7cec-fcdc-4d2c-b71f-af29345a74d7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:57.933492 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1353b608-5e10-487f-a693-8e3493152b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:58.002683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:58.022188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 433/871] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:54:58.037119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:58.047386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353b608-5e10-487f-a693-8e3493152b1d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:58.070477 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d7cec-fcdc-4d2c-b71f-af29345a74d7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:58.109851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9fd40-4d40-4ad6-ae40-85618ee0ae7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:58.110861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9fd40-4d40-4ad6-ae40-85618ee0ae7c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.111458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9fd40-4d40-4ad6-ae40-85618ee0ae7c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.112004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9fd40-4d40-4ad6-ae40-85618ee0ae7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.113223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9fd40-4d40-4ad6-ae40-85618ee0ae7c None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=842ffae8f3b04107b994e57bc880b59b) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:58.113768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9fd40-4d40-4ad6-ae40-85618ee0ae7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:58.115612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9fd40-4d40-4ad6-ae40-85618ee0ae7c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:58.122767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 439/872] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:54:57 2022] GET /identity/v3/role_assignments?user.id=842ffae8f3b04107b994e57bc880b59b&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=918b179f19b6437493eabe5394fa9af0 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:58.176747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353b608-5e10-487f-a693-8e3493152b1d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:58.215835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aad24-1453-48e5-9909-9c43f00db45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:58.216893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aad24-1453-48e5-9909-9c43f00db45e None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.217364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aad24-1453-48e5-9909-9c43f00db45e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.217839 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aad24-1453-48e5-9909-9c43f00db45e None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.218766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aad24-1453-48e5-9909-9c43f00db45e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:58.220447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aad24-1453-48e5-9909-9c43f00db45e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:58.322362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3194a-558e-4d5d-b8e5-57e6990f1da3 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.322542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3194a-558e-4d5d-b8e5-57e6990f1da3 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.322858 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3194a-558e-4d5d-b8e5-57e6990f1da3 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.324754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 440/873] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:54:58.330276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfd68b-d243-4c63-9733-f3f36754f7fd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.330555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfd68b-d243-4c63-9733-f3f36754f7fd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.330837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfd68b-d243-4c63-9733-f3f36754f7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.348324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-87cfd68b-d243-4c63-9733-f3f36754f7fd None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:58.349499 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-87cfd68b-d243-4c63-9733-f3f36754f7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:58.385604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 434/874] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:54:58 2022] POST /identity/v3/services => generated 251 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:54:58.448801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 441/875] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:54:58.472236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aad24-1453-48e5-9909-9c43f00db45e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:58.528490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:58.585926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aad24-1453-48e5-9909-9c43f00db45e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:58.622858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bacf30-469c-4c34-a793-4ac40d01f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:58.623544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bacf30-469c-4c34-a793-4ac40d01f600 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.623860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bacf30-469c-4c34-a793-4ac40d01f600 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.624143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bacf30-469c-4c34-a793-4ac40d01f600 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.624996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bacf30-469c-4c34-a793-4ac40d01f600 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:58.626316 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bacf30-469c-4c34-a793-4ac40d01f600 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:58.728513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 435/876] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:54:58 2022] POST /identity/v3/services => generated 269 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:54:58.778300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecad61-0b57-4b36-b778-f7f41c2a2bc7 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.778618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecad61-0b57-4b36-b778-f7f41c2a2bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.778869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecad61-0b57-4b36-b778-f7f41c2a2bc7 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.780582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 442/877] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:54:58.786867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f12f9e-8c05-4628-93fb-b93ade458268 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:58.787162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f12f9e-8c05-4628-93fb-b93ade458268 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:58.787450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f12f9e-8c05-4628-93fb-b93ade458268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:58.806740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b0f12f9e-8c05-4628-93fb-b93ade458268 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:54:58.808362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b0f12f9e-8c05-4628-93fb-b93ade458268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:54:58.901197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 436/878] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:54:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:54:58.926157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecad61-0b57-4b36-b778-f7f41c2a2bc7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:58.995533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:59.036660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecad61-0b57-4b36-b778-f7f41c2a2bc7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:59.072432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8ddb5-9761-4838-a9bf-3447c61b4654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:59.073308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8ddb5-9761-4838-a9bf-3447c61b4654 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.073592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8ddb5-9761-4838-a9bf-3447c61b4654 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.073869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8ddb5-9761-4838-a9bf-3447c61b4654 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.084577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8ddb5-9761-4838-a9bf-3447c61b4654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-15e8ddb5-9761-4838-a9bf-3447c61b4654 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:54:59.092681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:59.097411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:59.098310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 443/879] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 2 09:54:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:59.103308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f12f9e-8c05-4628-93fb-b93ade458268 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:59.139627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:59.206659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f12f9e-8c05-4628-93fb-b93ade458268 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:59.242159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd06ba-87ea-4ca2-a81f-59e33b1eafcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:59.242830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd06ba-87ea-4ca2-a81f-59e33b1eafcf None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.243110 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd06ba-87ea-4ca2-a81f-59e33b1eafcf None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.243384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd06ba-87ea-4ca2-a81f-59e33b1eafcf None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.244157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd06ba-87ea-4ca2-a81f-59e33b1eafcf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:59.244461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd06ba-87ea-4ca2-a81f-59e33b1eafcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:59.245818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd06ba-87ea-4ca2-a81f-59e33b1eafcf None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:59.254509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 437/880] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 2 09:54:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:59.259925 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8ddb5-9761-4838-a9bf-3447c61b4654 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:59.364058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8ddb5-9761-4838-a9bf-3447c61b4654 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:59.387949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:59.405125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6aff69-33bb-400b-82a7-5e92857a5ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:59.405125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aff69-33bb-400b-82a7-5e92857a5ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.405125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aff69-33bb-400b-82a7-5e92857a5ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.405125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6aff69-33bb-400b-82a7-5e92857a5ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.418445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6aff69-33bb-400b-82a7-5e92857a5ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:59.419942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6aff69-33bb-400b-82a7-5e92857a5ab2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-3c6aff69-33bb-400b-82a7-5e92857a5ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:54:59.438431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:59.439423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:59.441525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:54:59.441525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:54:59.441525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:54:59.441525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:59.441525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 444/881] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:59.446157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd06ba-87ea-4ca2-a81f-59e33b1eafcf None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:59.550647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:54:59.554644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd06ba-87ea-4ca2-a81f-59e33b1eafcf None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:59.588759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d77b66-5b60-4615-8673-1df0c173c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:59.589537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77b66-5b60-4615-8673-1df0c173c869 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.589707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77b66-5b60-4615-8673-1df0c173c869 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.589979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77b66-5b60-4615-8673-1df0c173c869 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.590699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d77b66-5b60-4615-8673-1df0c173c869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:59.591007 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d77b66-5b60-4615-8673-1df0c173c869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:59.592386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d77b66-5b60-4615-8673-1df0c173c869 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:59.605574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 438/882] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:59.610716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6aff69-33bb-400b-82a7-5e92857a5ab2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:59.723694 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6aff69-33bb-400b-82a7-5e92857a5ab2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:59.758741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbea827-50fb-4262-a1c1-2332b7fc3d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:59.759562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea827-50fb-4262-a1c1-2332b7fc3d12 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.759875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea827-50fb-4262-a1c1-2332b7fc3d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.760155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea827-50fb-4262-a1c1-2332b7fc3d12 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.768029 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbea827-50fb-4262-a1c1-2332b7fc3d12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:59.769725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbea827-50fb-4262-a1c1-2332b7fc3d12 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-7fbea827-50fb-4262-a1c1-2332b7fc3d12 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:54:59.785672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:54:59.786649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:54:59.787644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:54:59.787644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:54:59.787644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:54:59.787644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:54:59.787644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:54:59.787644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:54:59.787644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:54:59.787644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:54:59.787644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:54:59.787644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:54:59.787644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 445/883] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 2 09:54:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:54:59.792857 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d77b66-5b60-4615-8673-1df0c173c869 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:54:59.899168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d77b66-5b60-4615-8673-1df0c173c869 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:54:59.934752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034d702-9f9b-427b-bd0c-823f4717b3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:54:59.935468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034d702-9f9b-427b-bd0c-823f4717b3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:54:59.935835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034d702-9f9b-427b-bd0c-823f4717b3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:54:59.936159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034d702-9f9b-427b-bd0c-823f4717b3f0 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:54:59.936998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034d702-9f9b-427b-bd0c-823f4717b3f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:54:59.937308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034d702-9f9b-427b-bd0c-823f4717b3f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:54:59.938721 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5034d702-9f9b-427b-bd0c-823f4717b3f0 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:54:59.958205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 439/884] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 2 09:54:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:54:59.963462 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbea827-50fb-4262-a1c1-2332b7fc3d12 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.000338 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:00.069463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbea827-50fb-4262-a1c1-2332b7fc3d12 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:00.105597 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436bc66-c9fc-4c76-9a8d-ad172883d3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:00.106252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436bc66-c9fc-4c76-9a8d-ad172883d3bd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.106539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436bc66-c9fc-4c76-9a8d-ad172883d3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.106817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436bc66-c9fc-4c76-9a8d-ad172883d3bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.187055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436bc66-c9fc-4c76-9a8d-ad172883d3bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:00.188919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436bc66-c9fc-4c76-9a8d-ad172883d3bd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:00.227506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:00.301043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 446/885] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:54:59 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:00.311607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034d702-9f9b-427b-bd0c-823f4717b3f0 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.328019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:00.415168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034d702-9f9b-427b-bd0c-823f4717b3f0 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:00.451051 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cf0fa-ddd2-495c-b131-0908c915c62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:00.451932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cf0fa-ddd2-495c-b131-0908c915c62f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.452216 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cf0fa-ddd2-495c-b131-0908c915c62f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.452493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cf0fa-ddd2-495c-b131-0908c915c62f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.470457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cf0fa-ddd2-495c-b131-0908c915c62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:00.472677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cf0fa-ddd2-495c-b131-0908c915c62f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-964cf0fa-ddd2-495c-b131-0908c915c62f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:00.493094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:00.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:00.494982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:00.494982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:00.494982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:00.494982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:00.497428 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 440/886] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:00.505243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436bc66-c9fc-4c76-9a8d-ad172883d3bd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.614945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436bc66-c9fc-4c76-9a8d-ad172883d3bd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:00.652506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf6f66-d5eb-4d87-be8c-a2b622759294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:00.653179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6f66-d5eb-4d87-be8c-a2b622759294 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.653465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6f66-d5eb-4d87-be8c-a2b622759294 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.653746 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6f66-d5eb-4d87-be8c-a2b622759294 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.654481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf6f66-d5eb-4d87-be8c-a2b622759294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:00.654794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf6f66-d5eb-4d87-be8c-a2b622759294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:00.656219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf6f66-d5eb-4d87-be8c-a2b622759294 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:00.658713 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:00.669638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 447/887] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:00.675722 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cf0fa-ddd2-495c-b131-0908c915c62f None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.690470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5c5db-153a-473c-9ebb-8677ace265d1 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.690797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5c5db-153a-473c-9ebb-8677ace265d1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.691787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5c5db-153a-473c-9ebb-8677ace265d1 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.693121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 448/888] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:00.698735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b7964-0056-40cd-8201-2a87220bd241 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.699048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b7964-0056-40cd-8201-2a87220bd241 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.699333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b7964-0056-40cd-8201-2a87220bd241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.724791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-876b7964-0056-40cd-8201-2a87220bd241 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:00.725969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-876b7964-0056-40cd-8201-2a87220bd241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:00.763737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:00.800558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cf0fa-ddd2-495c-b131-0908c915c62f None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:00.809118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 449/889] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:00.836748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180cc2e-5e42-4788-9974-f2843a99abf8 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.837037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180cc2e-5e42-4788-9974-f2843a99abf8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.837321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6180cc2e-5e42-4788-9974-f2843a99abf8 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.838829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 450/890] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:00.839460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180cc2e-5e42-4788-9974-f2843a99abf8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.844494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5263738-9eba-4609-8352-f2d831d0020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:00.845309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263738-9eba-4609-8352-f2d831d0020f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.845599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263738-9eba-4609-8352-f2d831d0020f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.845878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5263738-9eba-4609-8352-f2d831d0020f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.854157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5263738-9eba-4609-8352-f2d831d0020f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:00.855639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5263738-9eba-4609-8352-f2d831d0020f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-e5263738-9eba-4609-8352-f2d831d0020f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:00.872195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:00.873096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:00.874017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:00.874017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:00.874017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:00.874017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:00.874017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:00.874017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:00.874017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:00.874017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:00.874017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 441/891] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:00.875093 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01c1c5-5abc-4869-9032-708ff9669891 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:00.875093 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01c1c5-5abc-4869-9032-708ff9669891 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:00.875353 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01c1c5-5abc-4869-9032-708ff9669891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:00.894038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7d01c1c5-5abc-4869-9032-708ff9669891 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:00.895469 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7d01c1c5-5abc-4869-9032-708ff9669891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:00.966209 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6180cc2e-5e42-4788-9974-f2843a99abf8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:00.969433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 442/892] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:00.969433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01c1c5-5abc-4869-9032-708ff9669891 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:00.997769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.007543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0cf6f-c87f-4366-bcbf-973599abc349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.008397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0cf6f-c87f-4366-bcbf-973599abc349 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.008685 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0cf6f-c87f-4366-bcbf-973599abc349 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.008969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0cf6f-c87f-4366-bcbf-973599abc349 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.011698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0cf6f-c87f-4366-bcbf-973599abc349 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.011698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0cf6f-c87f-4366-bcbf-973599abc349 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e6d0cf6f-c87f-4366-bcbf-973599abc349 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:01.024443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:01.025960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:01.027009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:01.029673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 451/893] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:01.030693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0cf6f-c87f-4366-bcbf-973599abc349 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.041880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.089981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01c1c5-5abc-4869-9032-708ff9669891 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.130867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d872c-771c-4fb2-bc1f-5a3afbfa09e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.131566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d872c-771c-4fb2-bc1f-5a3afbfa09e1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.131882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d872c-771c-4fb2-bc1f-5a3afbfa09e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.132165 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d872c-771c-4fb2-bc1f-5a3afbfa09e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.132955 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d872c-771c-4fb2-bc1f-5a3afbfa09e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:01.133278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d872c-771c-4fb2-bc1f-5a3afbfa09e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.134227 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0cf6f-c87f-4366-bcbf-973599abc349 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.134703 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d872c-771c-4fb2-bc1f-5a3afbfa09e1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.152763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 443/894] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:01.152763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d872c-771c-4fb2-bc1f-5a3afbfa09e1 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.175362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a229e28-c1c3-4e00-924e-07c3d675c369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.176195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a229e28-c1c3-4e00-924e-07c3d675c369 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.176481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a229e28-c1c3-4e00-924e-07c3d675c369 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.176758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a229e28-c1c3-4e00-924e-07c3d675c369 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.177419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a229e28-c1c3-4e00-924e-07c3d675c369 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.178821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a229e28-c1c3-4e00-924e-07c3d675c369 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-4a229e28-c1c3-4e00-924e-07c3d675c369 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:01.190722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:01.192043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:01.192905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 452/895] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:01.193774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a229e28-c1c3-4e00-924e-07c3d675c369 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.250514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.264756 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d872c-771c-4fb2-bc1f-5a3afbfa09e1 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.282302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.296362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a229e28-c1c3-4e00-924e-07c3d675c369 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.298893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3217041-cf9a-4ac1-b82e-467b7f3a03a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.299693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217041-cf9a-4ac1-b82e-467b7f3a03a0 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.300056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217041-cf9a-4ac1-b82e-467b7f3a03a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.300344 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3217041-cf9a-4ac1-b82e-467b7f3a03a0 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.301055 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3217041-cf9a-4ac1-b82e-467b7f3a03a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:01.301367 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3217041-cf9a-4ac1-b82e-467b7f3a03a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.302879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3217041-cf9a-4ac1-b82e-467b7f3a03a0 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.307532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 444/896] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:01.308325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3217041-cf9a-4ac1-b82e-467b7f3a03a0 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.333831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c141723-02a1-47e8-ac88-b4d9d2871d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.334484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141723-02a1-47e8-ac88-b4d9d2871d30 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.334770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141723-02a1-47e8-ac88-b4d9d2871d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.335044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c141723-02a1-47e8-ac88-b4d9d2871d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.335916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c141723-02a1-47e8-ac88-b4d9d2871d30 None admin] RBAC: Adding query filter params (role.id=009e0d0f2e644f589ccc0490f465ffa8, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=386b93ddf5434625850806abb77b4b7d) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:01.336239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c141723-02a1-47e8-ac88-b4d9d2871d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.337706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c141723-02a1-47e8-ac88-b4d9d2871d30 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.343116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 453/897] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/role_assignments?user.id=386b93ddf5434625850806abb77b4b7d&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=009e0d0f2e644f589ccc0490f465ffa8 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:01.344335 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1fe9-477e-4f3d-a26a-3d14cf2212b7 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.344624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1fe9-477e-4f3d-a26a-3d14cf2212b7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.344902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd1fe9-477e-4f3d-a26a-3d14cf2212b7 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.346120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 454/898] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:01.347522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd1fe9-477e-4f3d-a26a-3d14cf2212b7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.428912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3217041-cf9a-4ac1-b82e-467b7f3a03a0 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.465944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a9146-4003-42b6-822c-91330f87179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.466460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd1fe9-477e-4f3d-a26a-3d14cf2212b7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.466659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a9146-4003-42b6-822c-91330f87179f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.466918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a9146-4003-42b6-822c-91330f87179f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.467200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a9146-4003-42b6-822c-91330f87179f None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.467971 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a9146-4003-42b6-822c-91330f87179f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:01.468286 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a9146-4003-42b6-822c-91330f87179f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.469691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a9146-4003-42b6-822c-91330f87179f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.475397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 445/899] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:01.476812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79a29a-538c-4382-a075-c2e77264ada6 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.477108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79a29a-538c-4382-a075-c2e77264ada6 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.477391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79a29a-538c-4382-a075-c2e77264ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.489844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.496201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7f79a29a-538c-4382-a075-c2e77264ada6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:01.497418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7f79a29a-538c-4382-a075-c2e77264ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:01.512937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af03347-fd75-4aca-b997-aa4a7459170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.513703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af03347-fd75-4aca-b997-aa4a7459170f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.513992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af03347-fd75-4aca-b997-aa4a7459170f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.514275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af03347-fd75-4aca-b997-aa4a7459170f None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.515005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af03347-fd75-4aca-b997-aa4a7459170f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:01.515363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af03347-fd75-4aca-b997-aa4a7459170f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.516996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af03347-fd75-4aca-b997-aa4a7459170f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.524008 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 455/900] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:01.524792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af03347-fd75-4aca-b997-aa4a7459170f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.577532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.613154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 446/901] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:01.638032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79a29a-538c-4382-a075-c2e77264ada6 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.672827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af03347-fd75-4aca-b997-aa4a7459170f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.717255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdc211-3387-4358-b15d-4d30bc58089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.718371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc211-3387-4358-b15d-4d30bc58089f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.718868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc211-3387-4358-b15d-4d30bc58089f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.719351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdc211-3387-4358-b15d-4d30bc58089f None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.720331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdc211-3387-4358-b15d-4d30bc58089f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:01.720853 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdc211-3387-4358-b15d-4d30bc58089f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.723280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdc211-3387-4358-b15d-4d30bc58089f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.731312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 456/902] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:01.737641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdc211-3387-4358-b15d-4d30bc58089f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.776860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79a29a-538c-4382-a075-c2e77264ada6 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.809752 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.820419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd84c-8bb3-4ef3-9898-e52962e723fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.821687 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd84c-8bb3-4ef3-9898-e52962e723fc None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.821974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd84c-8bb3-4ef3-9898-e52962e723fc None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.822256 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd84c-8bb3-4ef3-9898-e52962e723fc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.822921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd84c-8bb3-4ef3-9898-e52962e723fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.825061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd84c-8bb3-4ef3-9898-e52962e723fc None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-a89fd84c-8bb3-4ef3-9898-e52962e723fc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:01.842000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:01.843217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:01.844358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 447/903] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:01.851449 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd84c-8bb3-4ef3-9898-e52962e723fc None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.857615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdc211-3387-4358-b15d-4d30bc58089f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:01.895724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:01.899243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e4000-c2cd-49d7-b109-39c86e911cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:01.900251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e4000-c2cd-49d7-b109-39c86e911cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:01.901000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e4000-c2cd-49d7-b109-39c86e911cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:01.901482 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e4000-c2cd-49d7-b109-39c86e911cf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:01.902486 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e4000-c2cd-49d7-b109-39c86e911cf5 None admin] RBAC: Adding query filter params (interface=public, service_id=cb7c766406414cb8a2b985f5d4b12c5f, region_id=RegionOne) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:01.903087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e4000-c2cd-49d7-b109-39c86e911cf5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:01.905032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e4000-c2cd-49d7-b109-39c86e911cf5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:01.911988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 457/904] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/endpoints?service_id=cb7c766406414cb8a2b985f5d4b12c5f&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:01.917522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e4000-c2cd-49d7-b109-39c86e911cf5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:01.979451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd84c-8bb3-4ef3-9898-e52962e723fc None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.026519 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b63f-3d6d-44eb-a589-08c61fb6da95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.027962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b63f-3d6d-44eb-a589-08c61fb6da95 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.028730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b63f-3d6d-44eb-a589-08c61fb6da95 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.029215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3b63f-3d6d-44eb-a589-08c61fb6da95 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.030728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b63f-3d6d-44eb-a589-08c61fb6da95 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:02.031243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b63f-3d6d-44eb-a589-08c61fb6da95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.034292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3b63f-3d6d-44eb-a589-08c61fb6da95 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.036296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e4000-c2cd-49d7-b109-39c86e911cf5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.041750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 448/905] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:02.047175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b63f-3d6d-44eb-a589-08c61fb6da95 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.052341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:02.078537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47515-e19c-4252-bfc0-e2e80a41cead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.079702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47515-e19c-4252-bfc0-e2e80a41cead None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.080231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47515-e19c-4252-bfc0-e2e80a41cead None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.080739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a47515-e19c-4252-bfc0-e2e80a41cead None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.086744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a47515-e19c-4252-bfc0-e2e80a41cead None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.086744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a47515-e19c-4252-bfc0-e2e80a41cead None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.089630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 458/906] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:01 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:55:02.173278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3b63f-3d6d-44eb-a589-08c61fb6da95 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.176649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:02.212933 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c15d2-74e8-4858-8083-ad18c3113a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.213619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c15d2-74e8-4858-8083-ad18c3113a51 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.213908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c15d2-74e8-4858-8083-ad18c3113a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.214191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c15d2-74e8-4858-8083-ad18c3113a51 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.214912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c15d2-74e8-4858-8083-ad18c3113a51 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:02.215225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c15d2-74e8-4858-8083-ad18c3113a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.216656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c15d2-74e8-4858-8083-ad18c3113a51 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.222775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 449/907] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:02.229124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47515-e19c-4252-bfc0-e2e80a41cead None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.343257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a47515-e19c-4252-bfc0-e2e80a41cead None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.380073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646f839-b2fd-4d1e-82df-8dd4dae53f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.381112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646f839-b2fd-4d1e-82df-8dd4dae53f46 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.381637 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646f839-b2fd-4d1e-82df-8dd4dae53f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.382136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646f839-b2fd-4d1e-82df-8dd4dae53f46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.383136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646f839-b2fd-4d1e-82df-8dd4dae53f46 None admin] RBAC: Adding query filter params (interface=public, service_id=64a85f04d0f644ca9e973af811d51e76, region_id=RegionOne) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:02.383692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646f839-b2fd-4d1e-82df-8dd4dae53f46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.385268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646f839-b2fd-4d1e-82df-8dd4dae53f46 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.395683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 459/908] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/endpoints?service_id=64a85f04d0f644ca9e973af811d51e76&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:02.398041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c15d2-74e8-4858-8083-ad18c3113a51 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:02.504433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c15d2-74e8-4858-8083-ad18c3113a51 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:02.541217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1cac2-b43e-4268-bffc-bc089a1233f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:02.542159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1cac2-b43e-4268-bffc-bc089a1233f9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:02.542452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1cac2-b43e-4268-bffc-bc089a1233f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:02.542809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1cac2-b43e-4268-bffc-bc089a1233f9 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:02.543472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1cac2-b43e-4268-bffc-bc089a1233f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:02.544876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1cac2-b43e-4268-bffc-bc089a1233f9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:02.551344 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 450/909] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:02 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:55:03.629344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c930959-18f0-4ef1-b856-17a0aa4199a4 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.629890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c930959-18f0-4ef1-b856-17a0aa4199a4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.629890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c930959-18f0-4ef1-b856-17a0aa4199a4 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.631481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 460/910] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:03.636888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212594bd-d30e-44da-813c-00d7174bb726 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.637285 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212594bd-d30e-44da-813c-00d7174bb726 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.637478 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212594bd-d30e-44da-813c-00d7174bb726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.654718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-212594bd-d30e-44da-813c-00d7174bb726 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:03.655903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-212594bd-d30e-44da-813c-00d7174bb726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:03.682835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:03.736039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 451/911] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:03.754042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c930959-18f0-4ef1-b856-17a0aa4199a4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:03.798100 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:03.867083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c930959-18f0-4ef1-b856-17a0aa4199a4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:03.909121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91d3c-47c5-44f9-9c2b-455e7beb8b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:03.910158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91d3c-47c5-44f9-9c2b-455e7beb8b52 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.910446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91d3c-47c5-44f9-9c2b-455e7beb8b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.910727 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91d3c-47c5-44f9-9c2b-455e7beb8b52 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.911671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91179936-995e-4cf5-bd0f-0c27acfbc5a5 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.911971 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91179936-995e-4cf5-bd0f-0c27acfbc5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.912277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91179936-995e-4cf5-bd0f-0c27acfbc5a5 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.913911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 452/912] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:03.918873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab777fd0-629f-43b1-a42d-08493ab0cbb2 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:03.919162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab777fd0-629f-43b1-a42d-08493ab0cbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:03.919443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab777fd0-629f-43b1-a42d-08493ab0cbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:03.922481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a91d3c-47c5-44f9-9c2b-455e7beb8b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-77a91d3c-47c5-44f9-9c2b-455e7beb8b52 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:03.931463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:03.932466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:03.933300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 461/913] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 2 09:55:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:03.939105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91d3c-47c5-44f9-9c2b-455e7beb8b52 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:03.939662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-ab777fd0-629f-43b1-a42d-08493ab0cbb2 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:03.941076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ab777fd0-629f-43b1-a42d-08493ab0cbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:04.023845 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 453/914] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:04.041062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab777fd0-629f-43b1-a42d-08493ab0cbb2 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.043908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.050187 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91d3c-47c5-44f9-9c2b-455e7beb8b52 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.096902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455d16b-9e36-43ba-9c0d-d9a225e21145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.098125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d16b-9e36-43ba-9c0d-d9a225e21145 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.098964 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d16b-9e36-43ba-9c0d-d9a225e21145 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.099396 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455d16b-9e36-43ba-9c0d-d9a225e21145 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.100345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455d16b-9e36-43ba-9c0d-d9a225e21145 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:04.100806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455d16b-9e36-43ba-9c0d-d9a225e21145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.102909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455d16b-9e36-43ba-9c0d-d9a225e21145 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.119755 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 462/915] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 2 09:55:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:04.121546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455d16b-9e36-43ba-9c0d-d9a225e21145 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.149954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.169335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab777fd0-629f-43b1-a42d-08493ab0cbb2 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.222793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaae72e-48d2-4501-901c-5ded97abd23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.224129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaae72e-48d2-4501-901c-5ded97abd23f None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.224643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaae72e-48d2-4501-901c-5ded97abd23f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.225409 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaae72e-48d2-4501-901c-5ded97abd23f None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.226831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaae72e-48d2-4501-901c-5ded97abd23f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.229064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaae72e-48d2-4501-901c-5ded97abd23f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.245586 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455d16b-9e36-43ba-9c0d-d9a225e21145 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.282299 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8e7cd-0775-490b-8fed-d2f3befe338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.283095 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8e7cd-0775-490b-8fed-d2f3befe338e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.283379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8e7cd-0775-490b-8fed-d2f3befe338e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.283765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8e7cd-0775-490b-8fed-d2f3befe338e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.295184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8e7cd-0775-490b-8fed-d2f3befe338e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.296814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8e7cd-0775-490b-8fed-d2f3befe338e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.310642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 454/916] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:04 2022] POST /identity/v3/services => generated 241 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2cb8e7cd-0775-490b-8fed-d2f3befe338e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:04.321035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:04.334712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:04.335724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:04.335724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:04.335724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:04.335724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:04.335724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 463/917] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:04.336006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaae72e-48d2-4501-901c-5ded97abd23f None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.461490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaae72e-48d2-4501-901c-5ded97abd23f None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.500677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dde50f-b4ed-445c-898b-e054897939af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.501694 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dde50f-b4ed-445c-898b-e054897939af None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.502160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dde50f-b4ed-445c-898b-e054897939af None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.502355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6da5b3-1aab-4efa-8122-dc31d5bec081 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.502745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6da5b3-1aab-4efa-8122-dc31d5bec081 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.503024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6da5b3-1aab-4efa-8122-dc31d5bec081 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.503450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dde50f-b4ed-445c-898b-e054897939af None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.504382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dde50f-b4ed-445c-898b-e054897939af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:04.504681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 464/918] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:04.505082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dde50f-b4ed-445c-898b-e054897939af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.506703 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dde50f-b4ed-445c-898b-e054897939af None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.510112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bfd61-0442-4c1b-a98c-fae5316c4aa4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.510405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bfd61-0442-4c1b-a98c-fae5316c4aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.510683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bfd61-0442-4c1b-a98c-fae5316c4aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.522323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 455/919] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:04.528150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dde50f-b4ed-445c-898b-e054897939af None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.533892 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-418bfd61-0442-4c1b-a98c-fae5316c4aa4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:04.535198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-418bfd61-0442-4c1b-a98c-fae5316c4aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:04.541746 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.544830 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.625951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 465/920] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:04.650679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bfd61-0442-4c1b-a98c-fae5316c4aa4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.655931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dde50f-b4ed-445c-898b-e054897939af None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.693593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86036af5-8e6e-4893-8fd4-d7509d8e98fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.694461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86036af5-8e6e-4893-8fd4-d7509d8e98fd None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.694678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86036af5-8e6e-4893-8fd4-d7509d8e98fd None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.694949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86036af5-8e6e-4893-8fd4-d7509d8e98fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.702953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86036af5-8e6e-4893-8fd4-d7509d8e98fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.704504 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86036af5-8e6e-4893-8fd4-d7509d8e98fd None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-86036af5-8e6e-4893-8fd4-d7509d8e98fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:04.724880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:04.725864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:04.726806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:04.726806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:04.726806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:04.726806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:04.726806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:04.726806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:04.726806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:04.726806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:04.726806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:04.726806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:04.726806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 456/921] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:04.732887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86036af5-8e6e-4893-8fd4-d7509d8e98fd None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.771474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bfd61-0442-4c1b-a98c-fae5316c4aa4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.808997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709986d-47a3-44b5-89c5-3ec8bafcbfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.809803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709986d-47a3-44b5-89c5-3ec8bafcbfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.810089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709986d-47a3-44b5-89c5-3ec8bafcbfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.810359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709986d-47a3-44b5-89c5-3ec8bafcbfc7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.811015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709986d-47a3-44b5-89c5-3ec8bafcbfc7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.812502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709986d-47a3-44b5-89c5-3ec8bafcbfc7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.823487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e709986d-47a3-44b5-89c5-3ec8bafcbfc7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:04.825264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:04.826248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:04.827190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 466/922] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:04.833506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709986d-47a3-44b5-89c5-3ec8bafcbfc7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.842871 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:04.871374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86036af5-8e6e-4893-8fd4-d7509d8e98fd None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.913521 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db27555-f9b2-4e4f-b0c6-fdda032e7f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.914222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27555-f9b2-4e4f-b0c6-fdda032e7f50 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.914507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27555-f9b2-4e4f-b0c6-fdda032e7f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.914783 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db27555-f9b2-4e4f-b0c6-fdda032e7f50 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.915640 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27555-f9b2-4e4f-b0c6-fdda032e7f50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:04.915949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27555-f9b2-4e4f-b0c6-fdda032e7f50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.917358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db27555-f9b2-4e4f-b0c6-fdda032e7f50 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:04.935553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 457/923] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:04.936916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f7e03-52be-463f-9411-3e0740c7b83b None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.937312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f7e03-52be-463f-9411-3e0740c7b83b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.937666 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f7e03-52be-463f-9411-3e0740c7b83b None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.939083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 458/924] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:04.941371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f7e03-52be-463f-9411-3e0740c7b83b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:04.953462 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709986d-47a3-44b5-89c5-3ec8bafcbfc7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:04.993728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579b6e7-9d52-4266-9f77-7b28de1eca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:04.994645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579b6e7-9d52-4266-9f77-7b28de1eca51 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:04.995120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579b6e7-9d52-4266-9f77-7b28de1eca51 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:04.995629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579b6e7-9d52-4266-9f77-7b28de1eca51 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:04.996616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579b6e7-9d52-4266-9f77-7b28de1eca51 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:04.997081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579b6e7-9d52-4266-9f77-7b28de1eca51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:04.998616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8579b6e7-9d52-4266-9f77-7b28de1eca51 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.009557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 467/925] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:05.010978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aceca-3ad7-4f64-8ceb-028136a4f42e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.011443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aceca-3ad7-4f64-8ceb-028136a4f42e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.011899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aceca-3ad7-4f64-8ceb-028136a4f42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.030473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a30aceca-3ad7-4f64-8ceb-028136a4f42e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:05.032010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a30aceca-3ad7-4f64-8ceb-028136a4f42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:05.050615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f7e03-52be-463f-9411-3e0740c7b83b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.082629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.092042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37a74f-0a06-4c81-83a6-390b6722beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.092951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37a74f-0a06-4c81-83a6-390b6722beca None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.093238 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37a74f-0a06-4c81-83a6-390b6722beca None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.093632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37a74f-0a06-4c81-83a6-390b6722beca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.099679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.104497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 468/926] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:05.105435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30aceca-3ad7-4f64-8ceb-028136a4f42e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.117039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37a74f-0a06-4c81-83a6-390b6722beca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.119248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37a74f-0a06-4c81-83a6-390b6722beca None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-0b37a74f-0a06-4c81-83a6-390b6722beca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:05.147617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:05.148575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:05.149479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:05.149479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:05.149479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:05.149479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:05.156120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 459/927] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:05.156120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37a74f-0a06-4c81-83a6-390b6722beca None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.215714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30aceca-3ad7-4f64-8ceb-028136a4f42e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.253552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9bc3f-5f2c-4cde-894d-31218b5347ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.254132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9bc3f-5f2c-4cde-894d-31218b5347ca None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.254412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9bc3f-5f2c-4cde-894d-31218b5347ca None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.254687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9bc3f-5f2c-4cde-894d-31218b5347ca None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.254922 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37a74f-0a06-4c81-83a6-390b6722beca None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.255395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9bc3f-5f2c-4cde-894d-31218b5347ca None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:05.255737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9bc3f-5f2c-4cde-894d-31218b5347ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.257106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9bc3f-5f2c-4cde-894d-31218b5347ca None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.262052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 469/928] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:05.262733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9bc3f-5f2c-4cde-894d-31218b5347ca None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.295169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f691bd-481d-447c-b701-df0a12f233a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.296014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f691bd-481d-447c-b701-df0a12f233a3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.296296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f691bd-481d-447c-b701-df0a12f233a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.296568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f691bd-481d-447c-b701-df0a12f233a3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.297218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f691bd-481d-447c-b701-df0a12f233a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.298568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f691bd-481d-447c-b701-df0a12f233a3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-05f691bd-481d-447c-b701-df0a12f233a3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:05.311261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:05.312302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:05.313160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 460/929] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:05.314061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f691bd-481d-447c-b701-df0a12f233a3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.334504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.361348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.371175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9bc3f-5f2c-4cde-894d-31218b5347ca None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.406001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c8145-78b3-460f-8c4b-6c20790a679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.406648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c8145-78b3-460f-8c4b-6c20790a679e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.406956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c8145-78b3-460f-8c4b-6c20790a679e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.407231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c8145-78b3-460f-8c4b-6c20790a679e None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.407976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c8145-78b3-460f-8c4b-6c20790a679e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:05.408282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c8145-78b3-460f-8c4b-6c20790a679e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.409846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c8145-78b3-460f-8c4b-6c20790a679e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.426760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 470/930] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:05.426931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f691bd-481d-447c-b701-df0a12f233a3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.427052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c8145-78b3-460f-8c4b-6c20790a679e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.461788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cc761-28af-4d8e-affc-25bd10350e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.462446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc761-28af-4d8e-affc-25bd10350e2c None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.462764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc761-28af-4d8e-affc-25bd10350e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.463008 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cc761-28af-4d8e-affc-25bd10350e2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.463780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cc761-28af-4d8e-affc-25bd10350e2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.465255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cc761-28af-4d8e-affc-25bd10350e2c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.528726 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c8145-78b3-460f-8c4b-6c20790a679e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.544007 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 461/931] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:05.555567 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.556762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cc761-28af-4d8e-affc-25bd10350e2c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.590216 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e9ec4-2e10-48e5-8d46-f22055e84945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.590216 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e9ec4-2e10-48e5-8d46-f22055e84945 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.590216 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e9ec4-2e10-48e5-8d46-f22055e84945 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.590216 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e9ec4-2e10-48e5-8d46-f22055e84945 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.590672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e9ec4-2e10-48e5-8d46-f22055e84945 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:05.590672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e9ec4-2e10-48e5-8d46-f22055e84945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.590672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e9ec4-2e10-48e5-8d46-f22055e84945 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.597508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 471/932] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:05.602950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e9ec4-2e10-48e5-8d46-f22055e84945 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.684248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.688825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cc761-28af-4d8e-affc-25bd10350e2c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.727087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e9ec4-2e10-48e5-8d46-f22055e84945 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.727652 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99680f1d-071a-4844-97b5-bc07303eb351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.728537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680f1d-071a-4844-97b5-bc07303eb351 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.728925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680f1d-071a-4844-97b5-bc07303eb351 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.729301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99680f1d-071a-4844-97b5-bc07303eb351 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.738132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99680f1d-071a-4844-97b5-bc07303eb351 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.739813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99680f1d-071a-4844-97b5-bc07303eb351 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-99680f1d-071a-4844-97b5-bc07303eb351 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:05.756600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:05.757759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:05.758860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:05.758860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:05.758860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:05.758860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:05.758860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:05.758860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:05.758860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:05.758860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:05.765299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 462/933] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:05.766379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99680f1d-071a-4844-97b5-bc07303eb351 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.781347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455795db-16e3-4ac6-9045-e66a7ae2af98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.782523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455795db-16e3-4ac6-9045-e66a7ae2af98 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.783127 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455795db-16e3-4ac6-9045-e66a7ae2af98 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.784251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455795db-16e3-4ac6-9045-e66a7ae2af98 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.785239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455795db-16e3-4ac6-9045-e66a7ae2af98 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:05.785827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455795db-16e3-4ac6-9045-e66a7ae2af98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.787650 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455795db-16e3-4ac6-9045-e66a7ae2af98 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.798796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 472/934] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:05.800713 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455795db-16e3-4ac6-9045-e66a7ae2af98 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.867978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:05.886426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99680f1d-071a-4844-97b5-bc07303eb351 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.933219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455795db-16e3-4ac6-9045-e66a7ae2af98 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:05.935098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1048443-d93b-40d6-92d6-db5dd40314b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.936903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1048443-d93b-40d6-92d6-db5dd40314b4 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.937414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1048443-d93b-40d6-92d6-db5dd40314b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.937903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1048443-d93b-40d6-92d6-db5dd40314b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.938886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1048443-d93b-40d6-92d6-db5dd40314b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:05.939384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1048443-d93b-40d6-92d6-db5dd40314b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.941690 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1048443-d93b-40d6-92d6-db5dd40314b4 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.959558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 463/935] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:05.966745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1048443-d93b-40d6-92d6-db5dd40314b4 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:05.975045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ee3ab-dc70-4cbb-a941-8dba5cec6990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:05.975834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ee3ab-dc70-4cbb-a941-8dba5cec6990 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:05.976183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ee3ab-dc70-4cbb-a941-8dba5cec6990 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:05.976527 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ee3ab-dc70-4cbb-a941-8dba5cec6990 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:05.977394 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ee3ab-dc70-4cbb-a941-8dba5cec6990 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:05.978896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ee3ab-dc70-4cbb-a941-8dba5cec6990 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:05.994473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:06.079988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1048443-d93b-40d6-92d6-db5dd40314b4 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:06.089269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 473/936] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:06.138335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84ed5b-bbdd-432d-9496-e54b92af1635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:06.139925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ed5b-bbdd-432d-9496-e54b92af1635 None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:06.140494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ed5b-bbdd-432d-9496-e54b92af1635 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:06.140772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ed5b-bbdd-432d-9496-e54b92af1635 None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/386b93ddf5434625850806abb77b4b7d/roles/009e0d0f2e644f589ccc0490f465ffa8` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:06.145015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84ed5b-bbdd-432d-9496-e54b92af1635 None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=386b93ddf5434625850806abb77b4b7d, role_id=009e0d0f2e644f589ccc0490f465ffa8)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:06.146967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84ed5b-bbdd-432d-9496-e54b92af1635 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:06.224968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 464/937] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:55:05 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/386b93ddf5434625850806abb77b4b7d/roles/009e0d0f2e644f589ccc0490f465ffa8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:55:06.656662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de6676-db26-4af6-b4cb-b0d6e17ac3c4 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:06.657049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de6676-db26-4af6-b4cb-b0d6e17ac3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:06.657231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de6676-db26-4af6-b4cb-b0d6e17ac3c4 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:06.658872 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 474/938] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:06.664183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032163b-15cd-4cab-ab0c-bb6e06b0d95f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:06.664472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032163b-15cd-4cab-ab0c-bb6e06b0d95f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:06.664748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032163b-15cd-4cab-ab0c-bb6e06b0d95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:06.682040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f032163b-15cd-4cab-ab0c-bb6e06b0d95f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:06.683209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f032163b-15cd-4cab-ab0c-bb6e06b0d95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:06.757893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 465/939] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:06.781516 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de6676-db26-4af6-b4cb-b0d6e17ac3c4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:06.910331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de6676-db26-4af6-b4cb-b0d6e17ac3c4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:06.913081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:06.948894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b64d83-7a69-41f4-9d07-71bb73beadea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:06.950059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b64d83-7a69-41f4-9d07-71bb73beadea None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:06.950544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b64d83-7a69-41f4-9d07-71bb73beadea None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:06.951037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b64d83-7a69-41f4-9d07-71bb73beadea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:06.951945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b64d83-7a69-41f4-9d07-71bb73beadea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:06.953540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b64d83-7a69-41f4-9d07-71bb73beadea None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-81b64d83-7a69-41f4-9d07-71bb73beadea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:06.966959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:06.968040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:06.968900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:06.971942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 475/940] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:06.979607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032163b-15cd-4cab-ab0c-bb6e06b0d95f None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:06.980947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:07.083236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032163b-15cd-4cab-ab0c-bb6e06b0d95f None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:07.119416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352a7f7-c453-40ee-b80a-ee48d2d22ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:07.120125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352a7f7-c453-40ee-b80a-ee48d2d22ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:07.120414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352a7f7-c453-40ee-b80a-ee48d2d22ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:07.120695 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352a7f7-c453-40ee-b80a-ee48d2d22ef4 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:07.121403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352a7f7-c453-40ee-b80a-ee48d2d22ef4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:07.121714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352a7f7-c453-40ee-b80a-ee48d2d22ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:07.123076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352a7f7-c453-40ee-b80a-ee48d2d22ef4 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:07.128575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 466/941] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:07.133840 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b64d83-7a69-41f4-9d07-71bb73beadea None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:07.234842 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b64d83-7a69-41f4-9d07-71bb73beadea None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:07.268611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729845cd-a494-481e-aba1-a60876f79354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:07.269326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729845cd-a494-481e-aba1-a60876f79354 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:07.269610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729845cd-a494-481e-aba1-a60876f79354 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:07.269929 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729845cd-a494-481e-aba1-a60876f79354 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:07.270647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729845cd-a494-481e-aba1-a60876f79354 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:07.270956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729845cd-a494-481e-aba1-a60876f79354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:07.272339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729845cd-a494-481e-aba1-a60876f79354 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:07.277930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 476/942] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:07.285027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352a7f7-c453-40ee-b80a-ee48d2d22ef4 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:07.359556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:07.396127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352a7f7-c453-40ee-b80a-ee48d2d22ef4 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:07.432775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ab80b-5b9d-47f1-b5a4-f35ce8853ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:07.433445 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ab80b-5b9d-47f1-b5a4-f35ce8853ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:07.433739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ab80b-5b9d-47f1-b5a4-f35ce8853ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:07.434016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ab80b-5b9d-47f1-b5a4-f35ce8853ac1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:07.434810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ab80b-5b9d-47f1-b5a4-f35ce8853ac1 None admin] RBAC: Adding query filter params (interface=public, service_id=53166f5f10644f2d8e9a0db056fc74d2, region_id=RegionOne) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:07.435122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ab80b-5b9d-47f1-b5a4-f35ce8853ac1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:07.436509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ab80b-5b9d-47f1-b5a4-f35ce8853ac1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:07.443358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 467/943] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 2 09:55:07 2022] GET /identity/v3/endpoints?service_id=53166f5f10644f2d8e9a0db056fc74d2&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:07.448675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729845cd-a494-481e-aba1-a60876f79354 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:07.482279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:07.556975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729845cd-a494-481e-aba1-a60876f79354 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:07.591741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b122ed7-f66f-4815-a495-ab799b7bd95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:07.592408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b122ed7-f66f-4815-a495-ab799b7bd95c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:07.592690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b122ed7-f66f-4815-a495-ab799b7bd95c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:07.592967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b122ed7-f66f-4815-a495-ab799b7bd95c None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:07.593650 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b122ed7-f66f-4815-a495-ab799b7bd95c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:07.595016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b122ed7-f66f-4815-a495-ab799b7bd95c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:07.601534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 477/944] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:07 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:55:08.035996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e55e4-117a-4b68-a88a-664c53257c1b None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.036513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e55e4-117a-4b68-a88a-664c53257c1b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.036591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e55e4-117a-4b68-a88a-664c53257c1b None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.038311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 468/945] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:08.044093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929b52-1dfa-435f-9a85-721c3d3c3878 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.044544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929b52-1dfa-435f-9a85-721c3d3c3878 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.044632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929b52-1dfa-435f-9a85-721c3d3c3878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.062095 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-90929b52-1dfa-435f-9a85-721c3d3c3878 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:08.063272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-90929b52-1dfa-435f-9a85-721c3d3c3878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:08.138181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 478/946] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:08.161907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e55e4-117a-4b68-a88a-664c53257c1b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.275990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e55e4-117a-4b68-a88a-664c53257c1b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.307361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.312818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7ae89-ec52-4dd8-a06a-7cc828a6bb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.313716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7ae89-ec52-4dd8-a06a-7cc828a6bb0e None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.314229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7ae89-ec52-4dd8-a06a-7cc828a6bb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.314757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7ae89-ec52-4dd8-a06a-7cc828a6bb0e None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.315770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7ae89-ec52-4dd8-a06a-7cc828a6bb0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.321927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7ae89-ec52-4dd8-a06a-7cc828a6bb0e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.321927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: WARNING keystone.server.flask.common [None req-58e7ae89-ec52-4dd8-a06a-7cc828a6bb0e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 09:55:08.369573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.sql.core [None req-58e7ae89-ec52-4dd8-a06a-7cc828a6bb0e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 09:55:08.369573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 09:55:08.369573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [parameters: {'id': 'f8c5d13fe7d1453a8b0e2354d1ffa31d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 09:55:08.369573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80300) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-58e7ae89-ec52-4dd8-a06a-7cc828a6bb0e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f8c5d13fe7d1453a8b0e2354d1ffa31d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f8c5d13fe7d1453a8b0e2354d1ffa31d. Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:55:08.387059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application result.read() Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 09:55:08.387972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application yield resource Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise self.value Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application session.commit() Jun 02 09:55:08.388959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self.session.flush() Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application compat.raise_( Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 09:55:08.389851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 09:55:08.390782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application result.read() Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:55:08.391761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [parameters: {'id': 'f8c5d13fe7d1453a8b0e2354d1ffa31d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:08.392659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:08.394296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:08.395275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:08.395275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 09:55:08.395275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 09:55:08.395275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:08.395275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:08.395275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 09:55:08.395275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 09:55:08.395275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f8c5d13fe7d1453a8b0e2354d1ffa31d. Jun 02 09:55:08.395275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:08.397729 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 469/947] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Jun 2 09:55:08 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:08.403494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90929b52-1dfa-435f-9a85-721c3d3c3878 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.432544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.507675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90929b52-1dfa-435f-9a85-721c3d3c3878 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.543066 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140b161-5793-484a-adf8-d6dfe8e7ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.543904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b161-5793-484a-adf8-d6dfe8e7ab2a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.544188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b161-5793-484a-adf8-d6dfe8e7ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.544530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140b161-5793-484a-adf8-d6dfe8e7ab2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.544987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f1a7b-62df-416f-a9f2-dad811eccea3 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.545291 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f1a7b-62df-416f-a9f2-dad811eccea3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.545579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f1a7b-62df-416f-a9f2-dad811eccea3 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.550443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 470/948] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:08.551964 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140b161-5793-484a-adf8-d6dfe8e7ab2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.552924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861783-98ec-4a49-8714-80a71efb115a None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.553404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140b161-5793-484a-adf8-d6dfe8e7ab2a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.553654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861783-98ec-4a49-8714-80a71efb115a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.554388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23861783-98ec-4a49-8714-80a71efb115a None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.556061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 471/949] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:08.556978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d6e93-bc3d-4f3f-9cc9-ee5c7c07047a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.557267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d6e93-bc3d-4f3f-9cc9-ee5c7c07047a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.557547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d6e93-bc3d-4f3f-9cc9-ee5c7c07047a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-9140b161-5793-484a-adf8-d6dfe8e7ab2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:08.571653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:08.572624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:08.574014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:08.574014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:08.574014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:08.574014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:08.574014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:08.574014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:08.574014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:08.574014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:08.574014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 479/950] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:08.574739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18097d69-1ca8-45e8-b15d-5da5bb813878 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.575029 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18097d69-1ca8-45e8-b15d-5da5bb813878 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.575306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18097d69-1ca8-45e8-b15d-5da5bb813878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.580019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e33d6e93-bc3d-4f3f-9cc9-ee5c7c07047a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:08.582302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e33d6e93-bc3d-4f3f-9cc9-ee5c7c07047a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:08.592197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-18097d69-1ca8-45e8-b15d-5da5bb813878 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:08.593344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-18097d69-1ca8-45e8-b15d-5da5bb813878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:08.663685 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 480/951] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:08.663685 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18097d69-1ca8-45e8-b15d-5da5bb813878 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.664004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 472/952] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:08.681291 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d6e93-bc3d-4f3f-9cc9-ee5c7c07047a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.683926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.772233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18097d69-1ca8-45e8-b15d-5da5bb813878 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.788441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d6e93-bc3d-4f3f-9cc9-ee5c7c07047a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.806252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.814535 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141d703-728d-4811-9c67-63e1cc0f0b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.818816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141d703-728d-4811-9c67-63e1cc0f0b88 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.818816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141d703-728d-4811-9c67-63e1cc0f0b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.818816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141d703-728d-4811-9c67-63e1cc0f0b88 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.818816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141d703-728d-4811-9c67-63e1cc0f0b88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:08.818816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141d703-728d-4811-9c67-63e1cc0f0b88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.818816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141d703-728d-4811-9c67-63e1cc0f0b88 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.823175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402168-83ef-48b4-82f5-21d3a347f2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:08.824008 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402168-83ef-48b4-82f5-21d3a347f2df None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:08.824291 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402168-83ef-48b4-82f5-21d3a347f2df None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:08.824567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c402168-83ef-48b4-82f5-21d3a347f2df None admin] PATH_INFO: `/v3/services/compute` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:08.825269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c402168-83ef-48b4-82f5-21d3a347f2df None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:08.826743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c402168-83ef-48b4-82f5-21d3a347f2df None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:08.838655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 481/953] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-2c402168-83ef-48b4-82f5-21d3a347f2df None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:08.838830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:08.840205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:08.841418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:08.843440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141d703-728d-4811-9c67-63e1cc0f0b88 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.845111 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 473/954] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:08.846617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402168-83ef-48b4-82f5-21d3a347f2df None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:08.950702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:08.976808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141d703-728d-4811-9c67-63e1cc0f0b88 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:08.992863 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c402168-83ef-48b4-82f5-21d3a347f2df None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.016207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80c9a-0b1b-45a6-9dc4-cba0afdb9691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.017319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80c9a-0b1b-45a6-9dc4-cba0afdb9691 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.018272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80c9a-0b1b-45a6-9dc4-cba0afdb9691 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.018736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80c9a-0b1b-45a6-9dc4-cba0afdb9691 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.031422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b80c9a-0b1b-45a6-9dc4-cba0afdb9691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:09.040115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5a69a-0ade-4919-bd3f-47c662e7e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.040799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5a69a-0ade-4919-bd3f-47c662e7e37e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.041253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5a69a-0ade-4919-bd3f-47c662e7e37e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.041612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5a69a-0ade-4919-bd3f-47c662e7e37e None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-89b80c9a-0b1b-45a6-9dc4-cba0afdb9691 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:09.041891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:09.042816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:09.043891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:09.044973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5a69a-0ade-4919-bd3f-47c662e7e37e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:09.044973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5a69a-0ade-4919-bd3f-47c662e7e37e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.044973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5a69a-0ade-4919-bd3f-47c662e7e37e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.047271 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 482/955] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:09.055629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 474/956] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:09.061000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80c9a-0b1b-45a6-9dc4-cba0afdb9691 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:09.061161 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5a69a-0ade-4919-bd3f-47c662e7e37e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:09.120358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:09.190248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5a69a-0ade-4919-bd3f-47c662e7e37e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.191730 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80c9a-0b1b-45a6-9dc4-cba0afdb9691 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.227759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680afc-e9e8-441d-a0d4-8c2e1eb5d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.228346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680afc-e9e8-441d-a0d4-8c2e1eb5d901 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.228631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680afc-e9e8-441d-a0d4-8c2e1eb5d901 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.228905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0680afc-e9e8-441d-a0d4-8c2e1eb5d901 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.229844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0680afc-e9e8-441d-a0d4-8c2e1eb5d901 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:09.230251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0680afc-e9e8-441d-a0d4-8c2e1eb5d901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.231764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0680afc-e9e8-441d-a0d4-8c2e1eb5d901 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.232108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19b0e6-447b-47ef-9659-8e8f7623f842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.232781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b0e6-447b-47ef-9659-8e8f7623f842 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.233241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b0e6-447b-47ef-9659-8e8f7623f842 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.233525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b0e6-447b-47ef-9659-8e8f7623f842 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.233976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:09.234569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19b0e6-447b-47ef-9659-8e8f7623f842 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:09.234889 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19b0e6-447b-47ef-9659-8e8f7623f842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.236278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19b0e6-447b-47ef-9659-8e8f7623f842 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.241105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 483/957] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 2 09:55:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:09.242920 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 475/958] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:09.246778 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680afc-e9e8-441d-a0d4-8c2e1eb5d901 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:09.358911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0680afc-e9e8-441d-a0d4-8c2e1eb5d901 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.397241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e5c60-7383-4137-9294-7247147d1387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.398053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e5c60-7383-4137-9294-7247147d1387 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.398333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e5c60-7383-4137-9294-7247147d1387 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.398606 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e5c60-7383-4137-9294-7247147d1387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.411502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e5c60-7383-4137-9294-7247147d1387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.413004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e5c60-7383-4137-9294-7247147d1387 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-794e5c60-7383-4137-9294-7247147d1387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:09.432564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:09.433571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:09.434930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:09.434930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:09.434930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:09.434930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:09.434930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 484/959] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:09.440084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19b0e6-447b-47ef-9659-8e8f7623f842 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:09.558795 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19b0e6-447b-47ef-9659-8e8f7623f842 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.571031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:09.600301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d93ee7-1294-4ac8-903f-11669c00de74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.601015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d93ee7-1294-4ac8-903f-11669c00de74 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.601573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d93ee7-1294-4ac8-903f-11669c00de74 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.602134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d93ee7-1294-4ac8-903f-11669c00de74 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.602899 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d93ee7-1294-4ac8-903f-11669c00de74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:09.603216 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d93ee7-1294-4ac8-903f-11669c00de74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.604640 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d93ee7-1294-4ac8-903f-11669c00de74 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.621549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 476/960] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:09.628766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e5c60-7383-4137-9294-7247147d1387 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:09.683226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:09.736545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e5c60-7383-4137-9294-7247147d1387 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.775510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e62e8-8bf4-4c76-901f-ad96c374c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.776723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e62e8-8bf4-4c76-901f-ad96c374c048 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.777215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e62e8-8bf4-4c76-901f-ad96c374c048 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.777695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e62e8-8bf4-4c76-901f-ad96c374c048 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.787145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e62e8-8bf4-4c76-901f-ad96c374c048 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.788954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e62e8-8bf4-4c76-901f-ad96c374c048 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-973e62e8-8bf4-4c76-901f-ad96c374c048 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:09.804524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:09.805538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:09.806571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:09.806571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:09.806571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:09.806571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:09.806571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:09.806571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:09.806571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:09.806571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:09.806571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 09:55:09.806571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:09.809268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 485/961] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 2 09:55:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:09.814625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d93ee7-1294-4ac8-903f-11669c00de74 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:09.929821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d93ee7-1294-4ac8-903f-11669c00de74 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:09.965387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edef95-dfe1-4fa2-b6d1-950182af2345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:09.966060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edef95-dfe1-4fa2-b6d1-950182af2345 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.966348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edef95-dfe1-4fa2-b6d1-950182af2345 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.966629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edef95-dfe1-4fa2-b6d1-950182af2345 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.967463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edef95-dfe1-4fa2-b6d1-950182af2345 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:09.967858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edef95-dfe1-4fa2-b6d1-950182af2345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:09.969340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edef95-dfe1-4fa2-b6d1-950182af2345 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:09.975450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0b1f6-4402-47da-8413-15ada8178583 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.975767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0b1f6-4402-47da-8413-15ada8178583 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.976047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0b1f6-4402-47da-8413-15ada8178583 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.977576 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 486/962] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:09.983017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41093a-b0be-4bc8-a3f3-efafed6bb81f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:09.983611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41093a-b0be-4bc8-a3f3-efafed6bb81f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:09.984106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41093a-b0be-4bc8-a3f3-efafed6bb81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:09.993761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 477/963] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jun 2 09:55:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:10.002933 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edef95-dfe1-4fa2-b6d1-950182af2345 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.006823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3c41093a-b0be-4bc8-a3f3-efafed6bb81f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:10.008349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3c41093a-b0be-4bc8-a3f3-efafed6bb81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:10.043999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.089914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 487/964] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:10.115955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41093a-b0be-4bc8-a3f3-efafed6bb81f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.145623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edef95-dfe1-4fa2-b6d1-950182af2345 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.165451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.197334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586817c-f05f-490c-8110-d1b3158f1d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.198024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586817c-f05f-490c-8110-d1b3158f1d15 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.198310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586817c-f05f-490c-8110-d1b3158f1d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.198589 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586817c-f05f-490c-8110-d1b3158f1d15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.235124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41093a-b0be-4bc8-a3f3-efafed6bb81f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.276175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c9cef-5c26-4b7e-85de-065e01d728a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.277409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c9cef-5c26-4b7e-85de-065e01d728a1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.278048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c9cef-5c26-4b7e-85de-065e01d728a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.278538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c9cef-5c26-4b7e-85de-065e01d728a1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.279470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c9cef-5c26-4b7e-85de-065e01d728a1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.281223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c9cef-5c26-4b7e-85de-065e01d728a1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.289175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586817c-f05f-490c-8110-d1b3158f1d15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.290905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586817c-f05f-490c-8110-d1b3158f1d15 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-232c9cef-5c26-4b7e-85de-065e01d728a1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:10.296460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:10.297483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:10.298413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:10.303664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 488/965] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:10.306364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c9cef-5c26-4b7e-85de-065e01d728a1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.326328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.405147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 478/966] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 09:55:10.410274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586817c-f05f-490c-8110-d1b3158f1d15 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.420887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c9cef-5c26-4b7e-85de-065e01d728a1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.424868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.457885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139a7fe-8a45-4d40-9ef8-6af2b8eec280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.458878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139a7fe-8a45-4d40-9ef8-6af2b8eec280 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.459385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139a7fe-8a45-4d40-9ef8-6af2b8eec280 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.459905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139a7fe-8a45-4d40-9ef8-6af2b8eec280 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.460808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139a7fe-8a45-4d40-9ef8-6af2b8eec280 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:10.461313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139a7fe-8a45-4d40-9ef8-6af2b8eec280 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.462866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139a7fe-8a45-4d40-9ef8-6af2b8eec280 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.468298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 489/967] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:10.477001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139a7fe-8a45-4d40-9ef8-6af2b8eec280 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.539075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586817c-f05f-490c-8110-d1b3158f1d15 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.571716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.581191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2381f-b9d6-48e7-addc-dca2241f4155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.582358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2381f-b9d6-48e7-addc-dca2241f4155 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.584104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2381f-b9d6-48e7-addc-dca2241f4155 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.584104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2381f-b9d6-48e7-addc-dca2241f4155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.593266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139a7fe-8a45-4d40-9ef8-6af2b8eec280 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.595073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2381f-b9d6-48e7-addc-dca2241f4155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.597049 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2381f-b9d6-48e7-addc-dca2241f4155 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-1ec2381f-b9d6-48e7-addc-dca2241f4155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:10.617869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:10.618833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:10.619777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:10.619777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:10.619777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:10.619777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:10.622300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 479/968] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:10.630545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2381f-b9d6-48e7-addc-dca2241f4155 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.630739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d887c4-7f92-4fd2-9bf6-c5e4d16f3737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.631128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d887c4-7f92-4fd2-9bf6-c5e4d16f3737 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.631420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d887c4-7f92-4fd2-9bf6-c5e4d16f3737 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.632767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d887c4-7f92-4fd2-9bf6-c5e4d16f3737 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.632767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d887c4-7f92-4fd2-9bf6-c5e4d16f3737 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:10.632767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d887c4-7f92-4fd2-9bf6-c5e4d16f3737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.635602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d887c4-7f92-4fd2-9bf6-c5e4d16f3737 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.639528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 490/969] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:10.649545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d887c4-7f92-4fd2-9bf6-c5e4d16f3737 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.691903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.764178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2381f-b9d6-48e7-addc-dca2241f4155 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.771559 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d887c4-7f92-4fd2-9bf6-c5e4d16f3737 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.810074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6d9e5-c222-424e-8e22-26fc9cf4134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.810287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a593c77-d5cb-4fa1-a51f-6478144ba1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.810767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6d9e5-c222-424e-8e22-26fc9cf4134a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.811054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6d9e5-c222-424e-8e22-26fc9cf4134a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.811335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6d9e5-c222-424e-8e22-26fc9cf4134a None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.811950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a593c77-d5cb-4fa1-a51f-6478144ba1fe None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.812157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6d9e5-c222-424e-8e22-26fc9cf4134a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:10.812473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6d9e5-c222-424e-8e22-26fc9cf4134a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.812802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a593c77-d5cb-4fa1-a51f-6478144ba1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.813278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a593c77-d5cb-4fa1-a51f-6478144ba1fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:10.813839 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6d9e5-c222-424e-8e22-26fc9cf4134a None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.814416 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a593c77-d5cb-4fa1-a51f-6478144ba1fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:10.816192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a593c77-d5cb-4fa1-a51f-6478144ba1fe None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:10.831641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 480/970] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:10.833786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6d9e5-c222-424e-8e22-26fc9cf4134a None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:10.879922 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:10.928378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 491/971] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:10.944043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6d9e5-c222-424e-8e22-26fc9cf4134a None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:10.990575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c9220-dae8-4c2f-bf6d-5ca96ab5be9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:10.991399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c9220-dae8-4c2f-bf6d-5ca96ab5be9c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:10.991727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c9220-dae8-4c2f-bf6d-5ca96ab5be9c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:10.992005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c9220-dae8-4c2f-bf6d-5ca96ab5be9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.000033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c9220-dae8-4c2f-bf6d-5ca96ab5be9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:11.001539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c9220-dae8-4c2f-bf6d-5ca96ab5be9c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-da0c9220-dae8-4c2f-bf6d-5ca96ab5be9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:11.019307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:11.020415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:11.021423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:11.021423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:11.021423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:11.021423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:11.021423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:11.021423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:11.021423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:11.021423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:11.021423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 481/972] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:11.028934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a593c77-d5cb-4fa1-a51f-6478144ba1fe None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:11.142132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:11.157146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a593c77-d5cb-4fa1-a51f-6478144ba1fe None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:11.194859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4792820-121a-473d-91ad-2856ffeaa840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:11.195545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4792820-121a-473d-91ad-2856ffeaa840 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.195853 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4792820-121a-473d-91ad-2856ffeaa840 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.196149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4792820-121a-473d-91ad-2856ffeaa840 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.196946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4792820-121a-473d-91ad-2856ffeaa840 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:11.197260 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4792820-121a-473d-91ad-2856ffeaa840 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:11.198707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4792820-121a-473d-91ad-2856ffeaa840 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:11.211531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 492/973] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:11.217796 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c9220-dae8-4c2f-bf6d-5ca96ab5be9c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:11.320203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:11.327091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c9220-dae8-4c2f-bf6d-5ca96ab5be9c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:11.363958 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e22540-51a1-4b60-89bd-1ce742dc9175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:11.364901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e22540-51a1-4b60-89bd-1ce742dc9175 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.365352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e22540-51a1-4b60-89bd-1ce742dc9175 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.365781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e22540-51a1-4b60-89bd-1ce742dc9175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.366823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e22540-51a1-4b60-89bd-1ce742dc9175 None admin] RBAC: Adding query filter params (role.id=009e0d0f2e644f589ccc0490f465ffa8, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=386b93ddf5434625850806abb77b4b7d) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:11.367310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e22540-51a1-4b60-89bd-1ce742dc9175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:11.368968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e22540-51a1-4b60-89bd-1ce742dc9175 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:11.375739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 482/974] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:11 2022] GET /identity/v3/role_assignments?user.id=386b93ddf5434625850806abb77b4b7d&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=009e0d0f2e644f589ccc0490f465ffa8 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:11.383009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024704da-10c7-488e-af62-8138c7b56d2d None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.383313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024704da-10c7-488e-af62-8138c7b56d2d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.383623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024704da-10c7-488e-af62-8138c7b56d2d None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.385117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 493/975] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:11.390957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da19ca-e020-4e3d-a51f-41f167b4c281 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.391708 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da19ca-e020-4e3d-a51f-41f167b4c281 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.392196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da19ca-e020-4e3d-a51f-41f167b4c281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.411670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c7da19ca-e020-4e3d-a51f-41f167b4c281 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:11.413419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c7da19ca-e020-4e3d-a51f-41f167b4c281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:11.492121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 483/976] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:11.518408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024704da-10c7-488e-af62-8138c7b56d2d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:11.634528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024704da-10c7-488e-af62-8138c7b56d2d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:11.673049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d48c6-cf1e-4f60-b7e5-3cbbfb34fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:11.673726 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d48c6-cf1e-4f60-b7e5-3cbbfb34fa62 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.674221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d48c6-cf1e-4f60-b7e5-3cbbfb34fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.674635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d48c6-cf1e-4f60-b7e5-3cbbfb34fa62 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.675686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d48c6-cf1e-4f60-b7e5-3cbbfb34fa62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:11.677546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d48c6-cf1e-4f60-b7e5-3cbbfb34fa62 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:11.678875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: WARNING keystone.server.flask.common [None req-677d48c6-cf1e-4f60-b7e5-3cbbfb34fa62 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 09:55:11.725542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.sql.core [None req-677d48c6-cf1e-4f60-b7e5-3cbbfb34fa62 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 09:55:11.725542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 09:55:11.725542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [parameters: {'user_id': 'a53095aba0b64a01a07a1665e486f5d1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 09:55:11.725542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80299) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-677d48c6-cf1e-4f60-b7e5-3cbbfb34fa62 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result.read() Jun 02 09:55:11.733194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:55:11.734824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application yield resource Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application next(self.gen) Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise self.value Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application session.commit() Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 09:55:11.735887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.session.flush() Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application compat.raise_( Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 09:55:11.736901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 09:55:11.737834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application conn.query(q) Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result.read() Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 09:55:11.738732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a53095aba0b64a01a07a1665e486f5d1', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:11.739627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 09:55:11.740463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 09:55:11.741428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 09:55:11.741428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 09:55:11.741428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 09:55:11.741428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 09:55:11.741428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 09:55:11.741428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:11.741428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 494/977] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jun 2 09:55:11 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:11.743194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da19ca-e020-4e3d-a51f-41f167b4c281 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:11.784319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a83236-5b37-4a63-9243-5eed59ebf5d9 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.784673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a83236-5b37-4a63-9243-5eed59ebf5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.784879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a83236-5b37-4a63-9243-5eed59ebf5d9 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.790663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 495/978] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:11.795835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6c9fb-0889-4a2e-8d2b-db9c42dfe2e5 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.796134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6c9fb-0889-4a2e-8d2b-db9c42dfe2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.796420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6c9fb-0889-4a2e-8d2b-db9c42dfe2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.813994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e8e6c9fb-0889-4a2e-8d2b-db9c42dfe2e5 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:11.816404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e8e6c9fb-0889-4a2e-8d2b-db9c42dfe2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:11.819935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:11.844891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:11.855354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da19ca-e020-4e3d-a51f-41f167b4c281 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:11.895987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675324a9-7146-4549-8066-15b9f39bc09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:11.896822 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675324a9-7146-4549-8066-15b9f39bc09f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:11.897108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675324a9-7146-4549-8066-15b9f39bc09f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:11.897387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675324a9-7146-4549-8066-15b9f39bc09f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:11.905203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675324a9-7146-4549-8066-15b9f39bc09f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:11.906743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675324a9-7146-4549-8066-15b9f39bc09f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:11.913514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 496/979] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-675324a9-7146-4549-8066-15b9f39bc09f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:11.928272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:11.929252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:11.930333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:11.930333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:11.930333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:11.930333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:11.930333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:11.930333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:11.930333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:11.930333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:11.930333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 09:55:11.930333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:11.933035 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 484/980] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:11.938327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6c9fb-0889-4a2e-8d2b-db9c42dfe2e5 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:11.941254 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675324a9-7146-4549-8066-15b9f39bc09f None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:12.054881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675324a9-7146-4549-8066-15b9f39bc09f None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:12.069553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6c9fb-0889-4a2e-8d2b-db9c42dfe2e5 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:12.094183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6236ae6-5001-43d6-99a9-dd2c038bb5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:12.095273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6236ae6-5001-43d6-99a9-dd2c038bb5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:12.095930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6236ae6-5001-43d6-99a9-dd2c038bb5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:12.096546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6236ae6-5001-43d6-99a9-dd2c038bb5e5 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:12.097662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6236ae6-5001-43d6-99a9-dd2c038bb5e5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:12.098175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6236ae6-5001-43d6-99a9-dd2c038bb5e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:12.099948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6236ae6-5001-43d6-99a9-dd2c038bb5e5 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:12.107897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a29dd7-66dc-4bb5-a874-f04e1400a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:12.108562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a29dd7-66dc-4bb5-a874-f04e1400a67a None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:12.108845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a29dd7-66dc-4bb5-a874-f04e1400a67a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:12.109123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a29dd7-66dc-4bb5-a874-f04e1400a67a None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:12.109858 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a29dd7-66dc-4bb5-a874-f04e1400a67a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:12.111925 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a29dd7-66dc-4bb5-a874-f04e1400a67a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:12.147608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 485/981] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jun 2 09:55:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:12.178884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:12.184966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 497/982] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:11 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:13.397502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f03e-0684-4225-96c6-41b63d6b1a71 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.398097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f03e-0684-4225-96c6-41b63d6b1a71 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.398097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1f03e-0684-4225-96c6-41b63d6b1a71 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.399571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 486/983] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:13.405204 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0cc94-5a62-41c5-b131-89ecb6d9b59b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.405688 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0cc94-5a62-41c5-b131-89ecb6d9b59b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.405789 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0cc94-5a62-41c5-b131-89ecb6d9b59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.424384 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-faf0cc94-5a62-41c5-b131-89ecb6d9b59b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:13.425952 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-faf0cc94-5a62-41c5-b131-89ecb6d9b59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:13.504614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 498/984] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:13.527827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1f03e-0684-4225-96c6-41b63d6b1a71 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:13.538778 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:13.629935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1f03e-0684-4225-96c6-41b63d6b1a71 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:13.663502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca82a7-95ee-4272-8960-8d58eae81498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:13.664253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca82a7-95ee-4272-8960-8d58eae81498 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.664529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca82a7-95ee-4272-8960-8d58eae81498 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.664797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca82a7-95ee-4272-8960-8d58eae81498 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.665442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca82a7-95ee-4272-8960-8d58eae81498 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:13.666806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca82a7-95ee-4272-8960-8d58eae81498 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-2bca82a7-95ee-4272-8960-8d58eae81498 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:13.679108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:13.680321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:13.681186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:13.683906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 487/985] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:13.686410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0cc94-5a62-41c5-b131-89ecb6d9b59b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:13.748748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fb58e-d383-4344-aab7-21dad9f4face None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.749187 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fb58e-d383-4344-aab7-21dad9f4face None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.749554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fb58e-d383-4344-aab7-21dad9f4face None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.751119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 488/986] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:13.756704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc68b2-e2d6-4c6a-b789-a834a970b067 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.756972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc68b2-e2d6-4c6a-b789-a834a970b067 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.757248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc68b2-e2d6-4c6a-b789-a834a970b067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.773400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-bbcc68b2-e2d6-4c6a-b789-a834a970b067 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:13.774569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-bbcc68b2-e2d6-4c6a-b789-a834a970b067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:13.788710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0cc94-5a62-41c5-b131-89ecb6d9b59b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:13.819305 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:13.827940 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cfed8-6d82-451a-a96d-d14d021e99ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:13.828604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cfed8-6d82-451a-a96d-d14d021e99ed None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.831976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cfed8-6d82-451a-a96d-d14d021e99ed None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.831976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cfed8-6d82-451a-a96d-d14d021e99ed None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.831976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cfed8-6d82-451a-a96d-d14d021e99ed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:13.831976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cfed8-6d82-451a-a96d-d14d021e99ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:13.831976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cfed8-6d82-451a-a96d-d14d021e99ed None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:13.836779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 499/987] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:13.842251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cfed8-6d82-451a-a96d-d14d021e99ed None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:13.844897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 489/988] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:13.872882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc68b2-e2d6-4c6a-b789-a834a970b067 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:13.875376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:13.953427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cfed8-6d82-451a-a96d-d14d021e99ed None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:13.977222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc68b2-e2d6-4c6a-b789-a834a970b067 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:13.991822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a997-0471-417b-b533-00ffeae43aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:13.992491 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a997-0471-417b-b533-00ffeae43aab None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:13.992782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a997-0471-417b-b533-00ffeae43aab None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:13.993049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a997-0471-417b-b533-00ffeae43aab None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:13.993760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526a997-0471-417b-b533-00ffeae43aab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:13.994069 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526a997-0471-417b-b533-00ffeae43aab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:13.995706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526a997-0471-417b-b533-00ffeae43aab None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.005979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 500/989] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:14.007714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a997-0471-417b-b533-00ffeae43aab None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.023823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1362092-c36e-4a67-9456-f5695c108605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.025376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1362092-c36e-4a67-9456-f5695c108605 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.025851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1362092-c36e-4a67-9456-f5695c108605 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.026372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1362092-c36e-4a67-9456-f5695c108605 None admin] PATH_INFO: `/v3/services/image` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.027316 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1362092-c36e-4a67-9456-f5695c108605 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.029644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1362092-c36e-4a67-9456-f5695c108605 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-d1362092-c36e-4a67-9456-f5695c108605 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:14.049826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:14.050907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:14.052235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 490/990] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jun 2 09:55:13 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:14.060298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1362092-c36e-4a67-9456-f5695c108605 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.100573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.142225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.149208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a997-0471-417b-b533-00ffeae43aab None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.185508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1362092-c36e-4a67-9456-f5695c108605 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.191433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce862f8b-20af-49e0-8d8b-cc1218e4c9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.192126 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862f8b-20af-49e0-8d8b-cc1218e4c9cc None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.192407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862f8b-20af-49e0-8d8b-cc1218e4c9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.192680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862f8b-20af-49e0-8d8b-cc1218e4c9cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.193483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce862f8b-20af-49e0-8d8b-cc1218e4c9cc None admin] RBAC: Adding query filter params (interface=admin, service_id=53166f5f10644f2d8e9a0db056fc74d2, region_id=RegionOne) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:14.193803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce862f8b-20af-49e0-8d8b-cc1218e4c9cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.195168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce862f8b-20af-49e0-8d8b-cc1218e4c9cc None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.200679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 501/991] 10.222.0.48 () {56 vars in 1249 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/endpoints?service_id=53166f5f10644f2d8e9a0db056fc74d2&interface=admin®ion_id=RegionOne => generated 193 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:14.206122 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce862f8b-20af-49e0-8d8b-cc1218e4c9cc None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.225229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55781bd-0a70-4aaf-8230-35496a419f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.226201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55781bd-0a70-4aaf-8230-35496a419f15 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.226735 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55781bd-0a70-4aaf-8230-35496a419f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.227651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55781bd-0a70-4aaf-8230-35496a419f15 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.228726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55781bd-0a70-4aaf-8230-35496a419f15 None admin] RBAC: Adding query filter params (name=image) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:14.229336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55781bd-0a70-4aaf-8230-35496a419f15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.230899 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55781bd-0a70-4aaf-8230-35496a419f15 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.236900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 491/992] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:14.243360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55781bd-0a70-4aaf-8230-35496a419f15 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.315649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce862f8b-20af-49e0-8d8b-cc1218e4c9cc None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.333993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.352034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedecdce-0782-46f1-9714-c9b23f157262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.352695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedecdce-0782-46f1-9714-c9b23f157262 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.352983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedecdce-0782-46f1-9714-c9b23f157262 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.353245 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedecdce-0782-46f1-9714-c9b23f157262 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.353936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedecdce-0782-46f1-9714-c9b23f157262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.355327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedecdce-0782-46f1-9714-c9b23f157262 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.356893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55781bd-0a70-4aaf-8230-35496a419f15 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.362073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 502/993] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:55:14.390069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.398197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27c0b0-bf18-4a3b-a63a-011596e71294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.403793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27c0b0-bf18-4a3b-a63a-011596e71294 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.403793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27c0b0-bf18-4a3b-a63a-011596e71294 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.403793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27c0b0-bf18-4a3b-a63a-011596e71294 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.403793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27c0b0-bf18-4a3b-a63a-011596e71294 None admin] RBAC: Adding query filter params (type=image) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:14.403793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27c0b0-bf18-4a3b-a63a-011596e71294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.403793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27c0b0-bf18-4a3b-a63a-011596e71294 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.410163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 492/994] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:14.492946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595539-8d4f-469c-885e-ef7eea948930 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.493479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595539-8d4f-469c-885e-ef7eea948930 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.493479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595539-8d4f-469c-885e-ef7eea948930 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.495043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 503/995] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:14.500962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6779525-ff65-4ad9-ae2f-556decd62778 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.501274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6779525-ff65-4ad9-ae2f-556decd62778 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.501531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6779525-ff65-4ad9-ae2f-556decd62778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.520860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f6779525-ff65-4ad9-ae2f-556decd62778 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:14.522136 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f6779525-ff65-4ad9-ae2f-556decd62778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:14.602282 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 493/996] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:14.625597 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7595539-8d4f-469c-885e-ef7eea948930 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.732176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7595539-8d4f-469c-885e-ef7eea948930 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.767852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdd1a2-9435-4c98-af8d-f0ffa324ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.768745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdd1a2-9435-4c98-af8d-f0ffa324ce41 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.769078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdd1a2-9435-4c98-af8d-f0ffa324ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.769360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbdd1a2-9435-4c98-af8d-f0ffa324ce41 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.770025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdd1a2-9435-4c98-af8d-f0ffa324ce41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.771406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbdd1a2-9435-4c98-af8d-f0ffa324ce41 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2dbdd1a2-9435-4c98-af8d-f0ffa324ce41 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:14.784300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:14.785293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:14.786156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 504/997] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:14.792833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6779525-ff65-4ad9-ae2f-556decd62778 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.893491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6779525-ff65-4ad9-ae2f-556decd62778 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:14.917843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:14.929377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78f352-2522-41ce-8469-9e99a3fedb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:14.930045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f352-2522-41ce-8469-9e99a3fedb78 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:14.935960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f352-2522-41ce-8469-9e99a3fedb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:14.935960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78f352-2522-41ce-8469-9e99a3fedb78 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:14.935960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78f352-2522-41ce-8469-9e99a3fedb78 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:14.935960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78f352-2522-41ce-8469-9e99a3fedb78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:14.935960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78f352-2522-41ce-8469-9e99a3fedb78 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:14.943621 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 494/998] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:14.944657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdd1a2-9435-4c98-af8d-f0ffa324ce41 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:14.993278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:15.047075 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbdd1a2-9435-4c98-af8d-f0ffa324ce41 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:15.082188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f5a23-b3e3-4936-acc0-34f40d85e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:15.082867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5a23-b3e3-4936-acc0-34f40d85e9ff None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:15.083142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5a23-b3e3-4936-acc0-34f40d85e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:15.083413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f5a23-b3e3-4936-acc0-34f40d85e9ff None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:15.084151 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f5a23-b3e3-4936-acc0-34f40d85e9ff None admin] RBAC: Adding query filter params (type=compute) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:15.084458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f5a23-b3e3-4936-acc0-34f40d85e9ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:15.085816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f5a23-b3e3-4936-acc0-34f40d85e9ff None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:15.096349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 505/999] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:15.097402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78f352-2522-41ce-8469-9e99a3fedb78 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:15.197926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78f352-2522-41ce-8469-9e99a3fedb78 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:15.231665 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3abae-0f4e-4998-9814-fcb4ea0f0aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:15.232320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3abae-0f4e-4998-9814-fcb4ea0f0aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:15.232600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3abae-0f4e-4998-9814-fcb4ea0f0aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:15.232870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3abae-0f4e-4998-9814-fcb4ea0f0aa7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:15.233647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3abae-0f4e-4998-9814-fcb4ea0f0aa7 None admin] RBAC: Adding query filter params (interface=public, service_id=8a87147385a1487ea5b55a4d385cf4a6, region_id=RegionOne) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:15.233956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3abae-0f4e-4998-9814-fcb4ea0f0aa7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:15.235307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3abae-0f4e-4998-9814-fcb4ea0f0aa7 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:15.240662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 495/1000] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 2 09:55:15 2022] GET /identity/v3/endpoints?service_id=8a87147385a1487ea5b55a4d385cf4a6&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:15.245887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f5a23-b3e3-4936-acc0-34f40d85e9ff None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:15.345457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f5a23-b3e3-4936-acc0-34f40d85e9ff None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:15.355470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:15.379826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a839d-d5e0-4ad4-a31e-e306c5ca8a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:15.380492 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a839d-d5e0-4ad4-a31e-e306c5ca8a4f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:15.380775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a839d-d5e0-4ad4-a31e-e306c5ca8a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:15.381049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a839d-d5e0-4ad4-a31e-e306c5ca8a4f None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:15.381728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a839d-d5e0-4ad4-a31e-e306c5ca8a4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:15.383091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a839d-d5e0-4ad4-a31e-e306c5ca8a4f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:15.390053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 506/1001] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:15 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 09:55:16.688800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe099b3-7535-4d0c-b3f7-b2ac9e02f551 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:16.689947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe099b3-7535-4d0c-b3f7-b2ac9e02f551 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:16.689947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe099b3-7535-4d0c-b3f7-b2ac9e02f551 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:16.691603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 496/1002] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:16.697007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8dc8a-9661-46b6-acf1-9eee60da285e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:16.697410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8dc8a-9661-46b6-acf1-9eee60da285e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:16.697616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8dc8a-9661-46b6-acf1-9eee60da285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:16.714893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-87c8dc8a-9661-46b6-acf1-9eee60da285e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:16.716106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-87c8dc8a-9661-46b6-acf1-9eee60da285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:16.764308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031ae0c-fae0-4e78-a384-479cdf3608d7 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:16.764972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031ae0c-fae0-4e78-a384-479cdf3608d7 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:16.764972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031ae0c-fae0-4e78-a384-479cdf3608d7 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:16.766209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 497/1003] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:16.771135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591805b-6b63-4505-a243-79afc0ff4485 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:16.771493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591805b-6b63-4505-a243-79afc0ff4485 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:16.771874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591805b-6b63-4505-a243-79afc0ff4485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:16.786011 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 507/1004] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:16.788798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5591805b-6b63-4505-a243-79afc0ff4485 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:16.790025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5591805b-6b63-4505-a243-79afc0ff4485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:16.809473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8dc8a-9661-46b6-acf1-9eee60da285e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:16.837632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:16.858592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 498/1005] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:16.881076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591805b-6b63-4505-a243-79afc0ff4485 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:16.923548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8dc8a-9661-46b6-acf1-9eee60da285e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:16.926470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:16.963790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783d592-da2c-44db-952d-c60121e6b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:16.964520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d592-da2c-44db-952d-c60121e6b2ef None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:16.964806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d592-da2c-44db-952d-c60121e6b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:16.965081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783d592-da2c-44db-952d-c60121e6b2ef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:16.965742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783d592-da2c-44db-952d-c60121e6b2ef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:16.967355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783d592-da2c-44db-952d-c60121e6b2ef None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-4783d592-da2c-44db-952d-c60121e6b2ef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:16.980822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:16.981877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 09:55:16.982742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:16.983601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591805b-6b63-4505-a243-79afc0ff4485 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:16.987922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 508/1006] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jun 2 09:55:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:16.988983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783d592-da2c-44db-952d-c60121e6b2ef None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.020760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7e52-a7f7-4b11-99d3-ce7e9ae77fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.021427 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7e52-a7f7-4b11-99d3-ce7e9ae77fce None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.021714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7e52-a7f7-4b11-99d3-ce7e9ae77fce None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.022159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a7e52-a7f7-4b11-99d3-ce7e9ae77fce None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.022723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a7e52-a7f7-4b11-99d3-ce7e9ae77fce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.024114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a7e52-a7f7-4b11-99d3-ce7e9ae77fce None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.092573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783d592-da2c-44db-952d-c60121e6b2ef None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.127544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cdfec-7103-44e8-8fa0-4cace5283304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.128243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cdfec-7103-44e8-8fa0-4cace5283304 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.128533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cdfec-7103-44e8-8fa0-4cace5283304 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.128918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cdfec-7103-44e8-8fa0-4cace5283304 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.129639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cdfec-7103-44e8-8fa0-4cace5283304 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:17.129954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cdfec-7103-44e8-8fa0-4cace5283304 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.131689 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cdfec-7103-44e8-8fa0-4cace5283304 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.137025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 509/1007] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:17.143052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cdfec-7103-44e8-8fa0-4cace5283304 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.151892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 499/1008] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:16 2022] POST /identity/v3/services => generated 242 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:55:17.180128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:17.258374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cdfec-7103-44e8-8fa0-4cace5283304 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.302030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08deb0ca-b140-4615-bfb4-401fa8ca5820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.302705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deb0ca-b140-4615-bfb4-401fa8ca5820 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.302988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deb0ca-b140-4615-bfb4-401fa8ca5820 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.303263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08deb0ca-b140-4615-bfb4-401fa8ca5820 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.304009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deb0ca-b140-4615-bfb4-401fa8ca5820 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:17.304319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deb0ca-b140-4615-bfb4-401fa8ca5820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.305782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08deb0ca-b140-4615-bfb4-401fa8ca5820 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.311710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 510/1009] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jun 2 09:55:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:17.317571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7e52-a7f7-4b11-99d3-ce7e9ae77fce None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.366482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:17.426070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a7e52-a7f7-4b11-99d3-ce7e9ae77fce None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.461010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76ae89-f6a1-4ad2-87b4-09d352ce5d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.461682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76ae89-f6a1-4ad2-87b4-09d352ce5d41 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.461973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76ae89-f6a1-4ad2-87b4-09d352ce5d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.462255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76ae89-f6a1-4ad2-87b4-09d352ce5d41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.463013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76ae89-f6a1-4ad2-87b4-09d352ce5d41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.464436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76ae89-f6a1-4ad2-87b4-09d352ce5d41 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.530545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 500/1010] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:17.658557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda8d4e-6a02-4cb1-97fb-b7d0374f5c42 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.658897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda8d4e-6a02-4cb1-97fb-b7d0374f5c42 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.659123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda8d4e-6a02-4cb1-97fb-b7d0374f5c42 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.660745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 511/1011] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:17.666304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b801f-b206-483a-b23a-4cb31b1abf59 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.666613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b801f-b206-483a-b23a-4cb31b1abf59 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.666881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b801f-b206-483a-b23a-4cb31b1abf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.685514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-312b801f-b206-483a-b23a-4cb31b1abf59 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:17.686735 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-312b801f-b206-483a-b23a-4cb31b1abf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:17.769825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 501/1012] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:17 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:17.793163 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda8d4e-6a02-4cb1-97fb-b7d0374f5c42 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.894458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:17.904456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda8d4e-6a02-4cb1-97fb-b7d0374f5c42 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:17.939002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374b1ac-2cb5-4134-95d0-b7dd71d77675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:17.940937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374b1ac-2cb5-4134-95d0-b7dd71d77675 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:17.941624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374b1ac-2cb5-4134-95d0-b7dd71d77675 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:17.942460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374b1ac-2cb5-4134-95d0-b7dd71d77675 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:17.943129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374b1ac-2cb5-4134-95d0-b7dd71d77675 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:17.944526 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374b1ac-2cb5-4134-95d0-b7dd71d77675 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-3374b1ac-2cb5-4134-95d0-b7dd71d77675 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:17.957249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:17.958272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 09:55:17.959158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:17.963411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 512/1013] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:17.964764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b801f-b206-483a-b23a-4cb31b1abf59 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:17.993230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:18.069594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b801f-b206-483a-b23a-4cb31b1abf59 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:18.106383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d612d-83fe-4016-bddc-2ecb0d808be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:18.107211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d612d-83fe-4016-bddc-2ecb0d808be5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:18.107499 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d612d-83fe-4016-bddc-2ecb0d808be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:18.107811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d612d-83fe-4016-bddc-2ecb0d808be5 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:18.108527 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d612d-83fe-4016-bddc-2ecb0d808be5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:18.108845 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d612d-83fe-4016-bddc-2ecb0d808be5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:18.110218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d612d-83fe-4016-bddc-2ecb0d808be5 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:18.120668 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 502/1014] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:18.122215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374b1ac-2cb5-4134-95d0-b7dd71d77675 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:18.224255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374b1ac-2cb5-4134-95d0-b7dd71d77675 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:18.266119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c46bfa-09d9-4611-abeb-6aa7a18e3bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:18.266776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c46bfa-09d9-4611-abeb-6aa7a18e3bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:18.267763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c46bfa-09d9-4611-abeb-6aa7a18e3bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:18.268172 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c46bfa-09d9-4611-abeb-6aa7a18e3bd7 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:18.268654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c46bfa-09d9-4611-abeb-6aa7a18e3bd7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:18.268962 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c46bfa-09d9-4611-abeb-6aa7a18e3bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:18.270320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c46bfa-09d9-4611-abeb-6aa7a18e3bd7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:18.275847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 513/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jun 2 09:55:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:18.281215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d612d-83fe-4016-bddc-2ecb0d808be5 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:18.377724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:18.390981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d612d-83fe-4016-bddc-2ecb0d808be5 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:18.437117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c835c-3fb0-4b41-bb06-e0a62ecc8c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:18.437777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c835c-3fb0-4b41-bb06-e0a62ecc8c2c None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:18.438059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c835c-3fb0-4b41-bb06-e0a62ecc8c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:18.438334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c835c-3fb0-4b41-bb06-e0a62ecc8c2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:18.439121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c835c-3fb0-4b41-bb06-e0a62ecc8c2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:18.440582 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c835c-3fb0-4b41-bb06-e0a62ecc8c2c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:18.543320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 503/1016] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:19.452690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ec896-97cc-42cb-a198-10a5767a2805 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.453235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ec896-97cc-42cb-a198-10a5767a2805 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.453235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ec896-97cc-42cb-a198-10a5767a2805 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.455328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 514/1017] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:19.460542 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113ceeb-356f-4aaa-ae0f-0adcfd4994f5 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.460989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113ceeb-356f-4aaa-ae0f-0adcfd4994f5 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.461173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113ceeb-356f-4aaa-ae0f-0adcfd4994f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.479059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-1113ceeb-356f-4aaa-ae0f-0adcfd4994f5 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:19.480333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1113ceeb-356f-4aaa-ae0f-0adcfd4994f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:19.556666 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 504/1018] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:19.578947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ec896-97cc-42cb-a198-10a5767a2805 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:19.602268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:19.682076 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ec896-97cc-42cb-a198-10a5767a2805 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:19.716153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4312a-3ded-4383-b54c-7278c51cd3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:19.716871 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4312a-3ded-4383-b54c-7278c51cd3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.717153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4312a-3ded-4383-b54c-7278c51cd3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.717426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4312a-3ded-4383-b54c-7278c51cd3a9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.718079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4312a-3ded-4383-b54c-7278c51cd3a9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:19.719451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4312a-3ded-4383-b54c-7278c51cd3a9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-bcd4312a-3ded-4383-b54c-7278c51cd3a9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:19.731691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:19.732701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:19.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:19.736592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 515/1019] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jun 2 09:55:19 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:19.739365 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113ceeb-356f-4aaa-ae0f-0adcfd4994f5 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:19.817906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:19.818823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86ae7-5499-4b2a-a23d-9ee23bca8ce6 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.819122 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86ae7-5499-4b2a-a23d-9ee23bca8ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.819383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a86ae7-5499-4b2a-a23d-9ee23bca8ce6 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.820939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 516/1020] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:19.825780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076a4cb-c713-4eb7-a3f9-41e6b854fa57 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.826074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076a4cb-c713-4eb7-a3f9-41e6b854fa57 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.826359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076a4cb-c713-4eb7-a3f9-41e6b854fa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.843558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4076a4cb-c713-4eb7-a3f9-41e6b854fa57 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:19.844789 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4076a4cb-c713-4eb7-a3f9-41e6b854fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:19.846031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113ceeb-356f-4aaa-ae0f-0adcfd4994f5 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:19.886313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68941331-a8b7-4273-b948-aca0094dc279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:19.886992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68941331-a8b7-4273-b948-aca0094dc279 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:19.887279 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68941331-a8b7-4273-b948-aca0094dc279 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:19.887558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68941331-a8b7-4273-b948-aca0094dc279 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:19.888305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68941331-a8b7-4273-b948-aca0094dc279 None admin] RBAC: Adding query filter params (name=image) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:19.888614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68941331-a8b7-4273-b948-aca0094dc279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:19.889984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68941331-a8b7-4273-b948-aca0094dc279 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:19.897411 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 505/1021] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:19.901960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68941331-a8b7-4273-b948-aca0094dc279 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:19.925888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 517/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:19.949592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076a4cb-c713-4eb7-a3f9-41e6b854fa57 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:19.965552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:20.014787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68941331-a8b7-4273-b948-aca0094dc279 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.054161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076a4cb-c713-4eb7-a3f9-41e6b854fa57 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.055091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e0c27-de95-4090-8d28-d85d95b37220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.055792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e0c27-de95-4090-8d28-d85d95b37220 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.056080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e0c27-de95-4090-8d28-d85d95b37220 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.056360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e0c27-de95-4090-8d28-d85d95b37220 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.057082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e0c27-de95-4090-8d28-d85d95b37220 None admin] RBAC: Adding query filter params (type=image) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:20.057395 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e0c27-de95-4090-8d28-d85d95b37220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.058759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e0c27-de95-4090-8d28-d85d95b37220 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.063917 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 506/1023] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:20.070080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e0c27-de95-4090-8d28-d85d95b37220 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.073262 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:20.093213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f2dad-3259-4d6b-a7ca-914c3ea88bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.094009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f2dad-3259-4d6b-a7ca-914c3ea88bbd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.094345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f2dad-3259-4d6b-a7ca-914c3ea88bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.094615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f2dad-3259-4d6b-a7ca-914c3ea88bbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.096425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f2dad-3259-4d6b-a7ca-914c3ea88bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.097868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f2dad-3259-4d6b-a7ca-914c3ea88bbd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.099697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 518/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:20.107803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f2dad-3259-4d6b-a7ca-914c3ea88bbd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.182953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e0c27-de95-4090-8d28-d85d95b37220 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.196239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:20.214418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f2dad-3259-4d6b-a7ca-914c3ea88bbd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.222268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c21fe-2d68-4ba4-b019-cb9e89aa71a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.223020 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c21fe-2d68-4ba4-b019-cb9e89aa71a3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.223313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c21fe-2d68-4ba4-b019-cb9e89aa71a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.223612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c21fe-2d68-4ba4-b019-cb9e89aa71a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.224425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c21fe-2d68-4ba4-b019-cb9e89aa71a3 None admin] RBAC: Adding query filter params (interface=public, service_id=c43b93f288354b01bd70860cc7ddb329, region_id=RegionOne) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:20.224744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c21fe-2d68-4ba4-b019-cb9e89aa71a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.226122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c21fe-2d68-4ba4-b019-cb9e89aa71a3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.231457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 507/1025] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 2 09:55:20 2022] GET /identity/v3/endpoints?service_id=c43b93f288354b01bd70860cc7ddb329&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:20.237187 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c21fe-2d68-4ba4-b019-cb9e89aa71a3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:20.255816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8fc15-6f2f-403b-a2ee-4fc8a2fa5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.256575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8fc15-6f2f-403b-a2ee-4fc8a2fa5990 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.256924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8fc15-6f2f-403b-a2ee-4fc8a2fa5990 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.257337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8fc15-6f2f-403b-a2ee-4fc8a2fa5990 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.257922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8fc15-6f2f-403b-a2ee-4fc8a2fa5990 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.259370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8fc15-6f2f-403b-a2ee-4fc8a2fa5990 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.306241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:20.345412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c21fe-2d68-4ba4-b019-cb9e89aa71a3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:20.359618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 519/1026] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:20 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:55:20.385097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a66a1-d389-46b7-9b5f-e766a0b42ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:20.385787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a66a1-d389-46b7-9b5f-e766a0b42ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.386077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a66a1-d389-46b7-9b5f-e766a0b42ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.386446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a66a1-d389-46b7-9b5f-e766a0b42ed3 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.387265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a66a1-d389-46b7-9b5f-e766a0b42ed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:20.388718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a66a1-d389-46b7-9b5f-e766a0b42ed3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:20.397816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 508/1027] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 2 09:55:20 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:55:20.914249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a85f-1756-4d59-a1ee-959e66d5a2b6 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.914784 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a85f-1756-4d59-a1ee-959e66d5a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.914784 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a85f-1756-4d59-a1ee-959e66d5a2b6 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.916369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 520/1028] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:20.921270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d42f-4bc0-4e7b-ac8b-27771f066412 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:20.921671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d42f-4bc0-4e7b-ac8b-27771f066412 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:20.921840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d42f-4bc0-4e7b-ac8b-27771f066412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:20.939637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a9b6d42f-4bc0-4e7b-ac8b-27771f066412 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:20.940834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a9b6d42f-4bc0-4e7b-ac8b-27771f066412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:21.009183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 509/1029] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:21.033287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2a85f-1756-4d59-a1ee-959e66d5a2b6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:21.157294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2a85f-1756-4d59-a1ee-959e66d5a2b6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.193774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db9b56-56cf-4478-8b1a-8481479784f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.194948 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db9b56-56cf-4478-8b1a-8481479784f4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.195442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db9b56-56cf-4478-8b1a-8481479784f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.195954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db9b56-56cf-4478-8b1a-8481479784f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.198260 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:21.208239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db9b56-56cf-4478-8b1a-8481479784f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e2db9b56-56cf-4478-8b1a-8481479784f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:21.216611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:21.217571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:21.223388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 521/1030] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 2 09:55:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:21.226019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6d42f-4bc0-4e7b-ac8b-27771f066412 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:21.289288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:21.331408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6d42f-4bc0-4e7b-ac8b-27771f066412 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.364257 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3261c-1313-41bf-a12b-97c386aab041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.364926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3261c-1313-41bf-a12b-97c386aab041 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.365205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3261c-1313-41bf-a12b-97c386aab041 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.365486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3261c-1313-41bf-a12b-97c386aab041 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.366231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3261c-1313-41bf-a12b-97c386aab041 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:21.366544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3261c-1313-41bf-a12b-97c386aab041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:21.367939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3261c-1313-41bf-a12b-97c386aab041 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:21.376770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 510/1031] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 2 09:55:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:21.382348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db9b56-56cf-4478-8b1a-8481479784f4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:21.484409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db9b56-56cf-4478-8b1a-8481479784f4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.519101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558993b-5ddb-4aba-b199-72f3c7147e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.519917 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558993b-5ddb-4aba-b199-72f3c7147e6c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.520202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558993b-5ddb-4aba-b199-72f3c7147e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.520478 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558993b-5ddb-4aba-b199-72f3c7147e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.530901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558993b-5ddb-4aba-b199-72f3c7147e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:21.532393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558993b-5ddb-4aba-b199-72f3c7147e6c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-5558993b-5ddb-4aba-b199-72f3c7147e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:21.552275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:21.553412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:21.558973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:21.558973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:21.558973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:21.558973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:21.558973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 522/1032] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:21.560867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3261c-1313-41bf-a12b-97c386aab041 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:21.664764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3261c-1313-41bf-a12b-97c386aab041 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.688129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:21.700895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50985c6-7450-41bc-ba6c-3a365099c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.720473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50985c6-7450-41bc-ba6c-3a365099c54f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.720473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50985c6-7450-41bc-ba6c-3a365099c54f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.720473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50985c6-7450-41bc-ba6c-3a365099c54f None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.720473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50985c6-7450-41bc-ba6c-3a365099c54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:21.720473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50985c6-7450-41bc-ba6c-3a365099c54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:21.720473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50985c6-7450-41bc-ba6c-3a365099c54f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:21.721270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 511/1033] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:21.723135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558993b-5ddb-4aba-b199-72f3c7147e6c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:21.774391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:21.828845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558993b-5ddb-4aba-b199-72f3c7147e6c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:21.868546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33e56-d641-4904-82c8-f6e22413091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:21.869404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33e56-d641-4904-82c8-f6e22413091e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:21.869697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33e56-d641-4904-82c8-f6e22413091e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:21.869977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f33e56-d641-4904-82c8-f6e22413091e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:21.880359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33e56-d641-4904-82c8-f6e22413091e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:21.881807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f33e56-d641-4904-82c8-f6e22413091e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e9f33e56-d641-4904-82c8-f6e22413091e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:21.896553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:21.897590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:21.898577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:21.898577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:21.898577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:21.898577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:21.898577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:21.898577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:21.898577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:21.898577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:21.898577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:21.898577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:21.902624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 523/1034] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 2 09:55:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:21.903986 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50985c6-7450-41bc-ba6c-3a365099c54f None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:22.005304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50985c6-7450-41bc-ba6c-3a365099c54f None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:22.039503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d0624-f8e0-4c05-8c8c-52fb2cbb2e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:22.040217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d0624-f8e0-4c05-8c8c-52fb2cbb2e38 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:22.040509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d0624-f8e0-4c05-8c8c-52fb2cbb2e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:22.040788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d0624-f8e0-4c05-8c8c-52fb2cbb2e38 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:22.041629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d0624-f8e0-4c05-8c8c-52fb2cbb2e38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:22.041945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d0624-f8e0-4c05-8c8c-52fb2cbb2e38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:22.043397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d0624-f8e0-4c05-8c8c-52fb2cbb2e38 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:22.061376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 512/1035] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 2 09:55:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:22.067828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33e56-d641-4904-82c8-f6e22413091e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:22.170137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f33e56-d641-4904-82c8-f6e22413091e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:22.178188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:22.205890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a6c36-0dbd-4e0a-9f08-d757efe6577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:22.206548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a6c36-0dbd-4e0a-9f08-d757efe6577f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:22.206836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a6c36-0dbd-4e0a-9f08-d757efe6577f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:22.207118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a6c36-0dbd-4e0a-9f08-d757efe6577f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:22.277732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a6c36-0dbd-4e0a-9f08-d757efe6577f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:22.279251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a6c36-0dbd-4e0a-9f08-d757efe6577f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:22.385918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 524/1036] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:22 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:22.392308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d0624-f8e0-4c05-8c8c-52fb2cbb2e38 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:22.437703 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:22.496522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d0624-f8e0-4c05-8c8c-52fb2cbb2e38 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:22.532921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3bac6-ee59-45f6-b19c-164b7ea942b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:22.533823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3bac6-ee59-45f6-b19c-164b7ea942b9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:22.534111 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3bac6-ee59-45f6-b19c-164b7ea942b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:22.534392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3bac6-ee59-45f6-b19c-164b7ea942b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:22.544737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3bac6-ee59-45f6-b19c-164b7ea942b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:22.546189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc3bac6-ee59-45f6-b19c-164b7ea942b9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-dbc3bac6-ee59-45f6-b19c-164b7ea942b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:22.564586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:22.565537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:22.566443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:22.566443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:22.566443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:22.566443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:22.567914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 513/1037] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:22.571640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a6c36-0dbd-4e0a-9f08-d757efe6577f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:22.580613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:22.673764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a6c36-0dbd-4e0a-9f08-d757efe6577f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:22.696793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887585fb-4ad0-4eff-93e6-9c1d289c35b2 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:22.697136 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887585fb-4ad0-4eff-93e6-9c1d289c35b2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:22.697363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887585fb-4ad0-4eff-93e6-9c1d289c35b2 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:22.698731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 514/1038] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:22.703498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f7b86-cddd-47a1-a6fd-c5a21279c0ad None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:22.703814 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f7b86-cddd-47a1-a6fd-c5a21279c0ad None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:22.704092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f7b86-cddd-47a1-a6fd-c5a21279c0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:22.711560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335393f-a3d2-4660-ab44-39dcaa3cac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:22.712262 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335393f-a3d2-4660-ab44-39dcaa3cac7c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:22.712552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335393f-a3d2-4660-ab44-39dcaa3cac7c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:22.712835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335393f-a3d2-4660-ab44-39dcaa3cac7c None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:22.713572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335393f-a3d2-4660-ab44-39dcaa3cac7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:22.713889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335393f-a3d2-4660-ab44-39dcaa3cac7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:22.715707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335393f-a3d2-4660-ab44-39dcaa3cac7c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:22.721232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e21f7b86-cddd-47a1-a6fd-c5a21279c0ad None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:22.722409 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e21f7b86-cddd-47a1-a6fd-c5a21279c0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:22.732190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 525/1039] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:22.732190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2327c3-ffa8-46bc-829c-e8271b20a51d None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:22.732190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2327c3-ffa8-46bc-829c-e8271b20a51d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:22.732190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2327c3-ffa8-46bc-829c-e8271b20a51d None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:22.732190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 526/1040] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:22.735924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2327c3-ffa8-46bc-829c-e8271b20a51d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:22.788266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 515/1041] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:22.789532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200a6bd-565c-4e7b-a9d4-ffa7f0bb2b57 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:22.789830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200a6bd-565c-4e7b-a9d4-ffa7f0bb2b57 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:22.790112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200a6bd-565c-4e7b-a9d4-ffa7f0bb2b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:22.802984 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:22.806183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5200a6bd-565c-4e7b-a9d4-ffa7f0bb2b57 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:22.807370 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5200a6bd-565c-4e7b-a9d4-ffa7f0bb2b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:22.824330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:22.838981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2327c3-ffa8-46bc-829c-e8271b20a51d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:22.872812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e730-582a-4a91-896e-18e74d622d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:22.873600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e730-582a-4a91-896e-18e74d622d66 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:22.873871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 516/1042] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:22.873967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e730-582a-4a91-896e-18e74d622d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:22.874147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e730-582a-4a91-896e-18e74d622d66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:22.874707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200a6bd-565c-4e7b-a9d4-ffa7f0bb2b57 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:22.884073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8e730-582a-4a91-896e-18e74d622d66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:22.885818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8e730-582a-4a91-896e-18e74d622d66 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-dae8e730-582a-4a91-896e-18e74d622d66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:22.902232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:22.903266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:22.904377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:22.904377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:22.904377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:22.904377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:22.904377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:22.904377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:22.904377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:22.904377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:22.907729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 527/1043] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:22.908836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e730-582a-4a91-896e-18e74d622d66 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:22.979527 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200a6bd-565c-4e7b-a9d4-ffa7f0bb2b57 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.007169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e730-582a-4a91-896e-18e74d622d66 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.013376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e8cf-d07a-4385-989e-68d1a052831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:23.014172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e8cf-d07a-4385-989e-68d1a052831e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.014458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e8cf-d07a-4385-989e-68d1a052831e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.014730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80e8cf-d07a-4385-989e-68d1a052831e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.015927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80e8cf-d07a-4385-989e-68d1a052831e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:23.017978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80e8cf-d07a-4385-989e-68d1a052831e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:23.019620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 517/1044] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:23.020368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e8cf-d07a-4385-989e-68d1a052831e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:23.037071 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:23.041061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:23.045908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c5a26-1733-47a3-b164-db70dd2b258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:23.046682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c5a26-1733-47a3-b164-db70dd2b258d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.046960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c5a26-1733-47a3-b164-db70dd2b258d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.053392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c5a26-1733-47a3-b164-db70dd2b258d None admin] PATH_INFO: `/v3/services/image` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.053392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c5a26-1733-47a3-b164-db70dd2b258d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:23.053392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c5a26-1733-47a3-b164-db70dd2b258d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-8d2c5a26-1733-47a3-b164-db70dd2b258d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:23.061033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:23.062052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:23.063167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 528/1045] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jun 2 09:55:22 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:23.064385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c5a26-1733-47a3-b164-db70dd2b258d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:23.118736 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80e8cf-d07a-4385-989e-68d1a052831e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.152546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35cfa4-5c75-4964-9993-c993af27cf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:23.153196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35cfa4-5c75-4964-9993-c993af27cf82 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.153480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35cfa4-5c75-4964-9993-c993af27cf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.153756 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35cfa4-5c75-4964-9993-c993af27cf82 None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.154535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35cfa4-5c75-4964-9993-c993af27cf82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:23.154844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35cfa4-5c75-4964-9993-c993af27cf82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:23.156288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35cfa4-5c75-4964-9993-c993af27cf82 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:23.165562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c5a26-1733-47a3-b164-db70dd2b258d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.167529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 518/1046] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:23.173749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35cfa4-5c75-4964-9993-c993af27cf82 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:23.199803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127f118-0acd-4d3a-9a7f-9733ee9db182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:23.200465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127f118-0acd-4d3a-9a7f-9733ee9db182 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.200744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127f118-0acd-4d3a-9a7f-9733ee9db182 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.201024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127f118-0acd-4d3a-9a7f-9733ee9db182 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.201722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127f118-0acd-4d3a-9a7f-9733ee9db182 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:23.203213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127f118-0acd-4d3a-9a7f-9733ee9db182 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:23.251940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:23.270596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35cfa4-5c75-4964-9993-c993af27cf82 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.272256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 529/1047] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:55:23 2022] POST /identity/v3/users => generated 285 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:23.273319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127f118-0acd-4d3a-9a7f-9733ee9db182 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:23.309871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b7a00-b3b3-425d-b5ce-581cb55db211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:23.310562 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b7a00-b3b3-425d-b5ce-581cb55db211 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.310846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b7a00-b3b3-425d-b5ce-581cb55db211 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.311120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b7a00-b3b3-425d-b5ce-581cb55db211 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.311915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b7a00-b3b3-425d-b5ce-581cb55db211 None admin] RBAC: Adding query filter params (name=image) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:23.312225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b7a00-b3b3-425d-b5ce-581cb55db211 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:23.314446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b7a00-b3b3-425d-b5ce-581cb55db211 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:23.325018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 519/1048] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:23.326706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b7a00-b3b3-425d-b5ce-581cb55db211 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:23.348903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:23.408327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127f118-0acd-4d3a-9a7f-9733ee9db182 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.445253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b7a00-b3b3-425d-b5ce-581cb55db211 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.446874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07580fd-f56e-4344-85c1-84364f1b9d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:23.447561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07580fd-f56e-4344-85c1-84364f1b9d88 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.447868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07580fd-f56e-4344-85c1-84364f1b9d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.448153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07580fd-f56e-4344-85c1-84364f1b9d88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.449006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07580fd-f56e-4344-85c1-84364f1b9d88 None admin] RBAC: Adding query filter params (role.id=009e0d0f2e644f589ccc0490f465ffa8, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=ba690590103a4019a56b191e8dfe3231) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:23.449327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07580fd-f56e-4344-85c1-84364f1b9d88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:23.450790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07580fd-f56e-4344-85c1-84364f1b9d88 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:23.459280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 530/1049] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:23 2022] GET /identity/v3/role_assignments?user.id=ba690590103a4019a56b191e8dfe3231&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=009e0d0f2e644f589ccc0490f465ffa8 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:23.492288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de434c3f-04ba-49d8-91b9-84d27c7707ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:23.493791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434c3f-04ba-49d8-91b9-84d27c7707ba None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.494081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434c3f-04ba-49d8-91b9-84d27c7707ba None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.494359 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de434c3f-04ba-49d8-91b9-84d27c7707ba None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.495095 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434c3f-04ba-49d8-91b9-84d27c7707ba None admin] RBAC: Adding query filter params (type=image) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:23.495424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434c3f-04ba-49d8-91b9-84d27c7707ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:23.496942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de434c3f-04ba-49d8-91b9-84d27c7707ba None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:23.505517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 520/1050] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:23.509550 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07580fd-f56e-4344-85c1-84364f1b9d88 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:23.627504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07580fd-f56e-4344-85c1-84364f1b9d88 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:23.639153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:23.665748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6145-ad42-44ef-8a64-239f427d5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:23.666471 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6145-ad42-44ef-8a64-239f427d5841 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:23.666758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6145-ad42-44ef-8a64-239f427d5841 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:23.667042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6145-ad42-44ef-8a64-239f427d5841 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:23.668602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f6145-ad42-44ef-8a64-239f427d5841 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:23.669230 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f6145-ad42-44ef-8a64-239f427d5841 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:23.747613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 531/1051] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 2 09:55:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:25.757488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100230-56fd-4247-bbb9-03ce309bf333 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:25.758086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100230-56fd-4247-bbb9-03ce309bf333 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:25.758086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f100230-56fd-4247-bbb9-03ce309bf333 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:25.759692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 521/1052] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:25.765589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5552d-b12f-4b4c-b0c8-1bc8d0bbb0b2 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:25.766132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5552d-b12f-4b4c-b0c8-1bc8d0bbb0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:25.766215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5552d-b12f-4b4c-b0c8-1bc8d0bbb0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:25.769459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8c1d8-8ac5-40b5-93ce-1d71fab4e8db None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:25.769753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8c1d8-8ac5-40b5-93ce-1d71fab4e8db None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:25.770028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8c1d8-8ac5-40b5-93ce-1d71fab4e8db None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:25.771566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 522/1053] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:25.777744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7606e2-6f9f-4adf-af54-82e6f79f537c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:25.778076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7606e2-6f9f-4adf-af54-82e6f79f537c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:25.778310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7606e2-6f9f-4adf-af54-82e6f79f537c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:25.786436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7cb5552d-b12f-4b4c-b0c8-1bc8d0bbb0b2 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:25.787678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7cb5552d-b12f-4b4c-b0c8-1bc8d0bbb0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:25.795471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5b7606e2-6f9f-4adf-af54-82e6f79f537c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:25.796666 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5b7606e2-6f9f-4adf-af54-82e6f79f537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:25.799214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:25.871107 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 532/1054] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:25.879609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 523/1055] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:25.895973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5552d-b12f-4b4c-b0c8-1bc8d0bbb0b2 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:25.898479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7606e2-6f9f-4adf-af54-82e6f79f537c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:25.993330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:26.002356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5552d-b12f-4b4c-b0c8-1bc8d0bbb0b2 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.014299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7606e2-6f9f-4adf-af54-82e6f79f537c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.039715 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1c1b2-6351-4d2e-b1b2-43c23a06f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:26.040423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c1b2-6351-4d2e-b1b2-43c23a06f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.040704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c1b2-6351-4d2e-b1b2-43c23a06f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.040975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1c1b2-6351-4d2e-b1b2-43c23a06f4b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.052580 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1c1b2-6351-4d2e-b1b2-43c23a06f4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:26.052953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d149b5-2779-4389-9f04-42f003f11ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:26.053766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d149b5-2779-4389-9f04-42f003f11ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.054055 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d149b5-2779-4389-9f04-42f003f11ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.054336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d149b5-2779-4389-9f04-42f003f11ae9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.056287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-8df1c1b2-6351-4d2e-b1b2-43c23a06f4b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:26.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:26.062556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:26.063652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 533/1056] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:26.067422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d149b5-2779-4389-9f04-42f003f11ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:26.068889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1c1b2-6351-4d2e-b1b2-43c23a06f4b9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-89d149b5-2779-4389-9f04-42f003f11ae9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:26.075840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:26.076800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 524/1057] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 2 09:55:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:26.086231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d149b5-2779-4389-9f04-42f003f11ae9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:26.171649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1c1b2-6351-4d2e-b1b2-43c23a06f4b9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.188565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d149b5-2779-4389-9f04-42f003f11ae9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.207433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88420fc2-3259-411c-876c-4cc4b7e00f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:26.208548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420fc2-3259-411c-876c-4cc4b7e00f6f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.208864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420fc2-3259-411c-876c-4cc4b7e00f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.209149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88420fc2-3259-411c-876c-4cc4b7e00f6f None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.209908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88420fc2-3259-411c-876c-4cc4b7e00f6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:26.210221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88420fc2-3259-411c-876c-4cc4b7e00f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:26.211611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88420fc2-3259-411c-876c-4cc4b7e00f6f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:26.220744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 534/1058] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:26.221996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6b00c-ef71-4a06-abed-c5222c47cb41 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.222282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6b00c-ef71-4a06-abed-c5222c47cb41 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.222566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6b00c-ef71-4a06-abed-c5222c47cb41 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.223869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9de756-d558-410a-a7b8-8385f1cd7bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:26.224069 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 535/1059] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:26.224894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de756-d558-410a-a7b8-8385f1cd7bcb None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.225513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de756-d558-410a-a7b8-8385f1cd7bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.225798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9de756-d558-410a-a7b8-8385f1cd7bcb None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.226673 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9de756-d558-410a-a7b8-8385f1cd7bcb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:26.227087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9de756-d558-410a-a7b8-8385f1cd7bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:26.228503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9de756-d558-410a-a7b8-8385f1cd7bcb None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:26.228639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6b00c-ef71-4a06-abed-c5222c47cb41 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:26.237874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 525/1060] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 2 09:55:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:26.239175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3d1d-d2f0-40fa-9c16-47df857c3378 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.239468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3d1d-d2f0-40fa-9c16-47df857c3378 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.239774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3d1d-d2f0-40fa-9c16-47df857c3378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.249994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:26.256848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-4c0e3d1d-d2f0-40fa-9c16-47df857c3378 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:26.258027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4c0e3d1d-d2f0-40fa-9c16-47df857c3378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:26.308574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:26.324493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 526/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:26.325384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3d1d-d2f0-40fa-9c16-47df857c3378 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:26.335382 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6b00c-ef71-4a06-abed-c5222c47cb41 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.370613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643f143-cf05-496f-a7d8-47de7c39af26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:26.371487 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643f143-cf05-496f-a7d8-47de7c39af26 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.371793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643f143-cf05-496f-a7d8-47de7c39af26 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.372068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643f143-cf05-496f-a7d8-47de7c39af26 None admin] PATH_INFO: `/v3/users/ddb93e7597c143c9a81ab9d3cae2435c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.385705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643f143-cf05-496f-a7d8-47de7c39af26 None admin] RBAC: Authorizing `identity:get_user(user_id=ddb93e7597c143c9a81ab9d3cae2435c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:26.387142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643f143-cf05-496f-a7d8-47de7c39af26 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:26.388836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 536/1062] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:26 2022] GET /identity/v3/users/ddb93e7597c143c9a81ab9d3cae2435c => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:26.393760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643f143-cf05-496f-a7d8-47de7c39af26 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:26.425341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3d1d-d2f0-40fa-9c16-47df857c3378 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.458646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f5775-2506-41f7-8d56-012db0495c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:26.459446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f5775-2506-41f7-8d56-012db0495c04 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.459758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f5775-2506-41f7-8d56-012db0495c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.460039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f5775-2506-41f7-8d56-012db0495c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.471320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:26.471696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f5775-2506-41f7-8d56-012db0495c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:26.475633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f5775-2506-41f7-8d56-012db0495c04 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-7b4f5775-2506-41f7-8d56-012db0495c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:26.492420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:26.493505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:26.494442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:26.494442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:26.494442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:26.494442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:26.494442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 527/1063] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:26.494442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f5775-2506-41f7-8d56-012db0495c04 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:26.505018 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643f143-cf05-496f-a7d8-47de7c39af26 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.535066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:26.539935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7d14-129e-49dc-abe4-aa1e78188ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:26.540580 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7d14-129e-49dc-abe4-aa1e78188ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.540864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7d14-129e-49dc-abe4-aa1e78188ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.541137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7d14-129e-49dc-abe4-aa1e78188ba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.593958 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f5775-2506-41f7-8d56-012db0495c04 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.624550 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7d14-129e-49dc-abe4-aa1e78188ba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:26.626100 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7d14-129e-49dc-abe4-aa1e78188ba2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:26.627502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f453e4-ac86-41e3-b59e-ad6246d7c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:26.628173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f453e4-ac86-41e3-b59e-ad6246d7c70a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.628459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f453e4-ac86-41e3-b59e-ad6246d7c70a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.628734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f453e4-ac86-41e3-b59e-ad6246d7c70a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.692397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:26.695178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f453e4-ac86-41e3-b59e-ad6246d7c70a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:26.696663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f453e4-ac86-41e3-b59e-ad6246d7c70a None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:26.725304 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 537/1064] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:26.725950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7d14-129e-49dc-abe4-aa1e78188ba2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:26.741071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:26.819166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 528/1065] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:26.820032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f453e4-ac86-41e3-b59e-ad6246d7c70a None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:26.833488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7d14-129e-49dc-abe4-aa1e78188ba2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.868458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d1a33-ecb3-4812-a6f5-00833a1abd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:26.869123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d1a33-ecb3-4812-a6f5-00833a1abd18 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.869409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d1a33-ecb3-4812-a6f5-00833a1abd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.869688 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d1a33-ecb3-4812-a6f5-00833a1abd18 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.870418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d1a33-ecb3-4812-a6f5-00833a1abd18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:26.870732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d1a33-ecb3-4812-a6f5-00833a1abd18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:26.872143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d1a33-ecb3-4812-a6f5-00833a1abd18 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:26.885302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 538/1066] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:26.886126 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d1a33-ecb3-4812-a6f5-00833a1abd18 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:26.917871 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:26.924087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f453e4-ac86-41e3-b59e-ad6246d7c70a None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.958216 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8c32e-03ef-46c3-8122-6bb424bdcb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:26.959017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c32e-03ef-46c3-8122-6bb424bdcb9d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:26.959302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c32e-03ef-46c3-8122-6bb424bdcb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:26.959601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c32e-03ef-46c3-8122-6bb424bdcb9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:26.966092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:26.970338 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8c32e-03ef-46c3-8122-6bb424bdcb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:26.972108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8c32e-03ef-46c3-8122-6bb424bdcb9d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:26.987855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d1a33-ecb3-4812-a6f5-00833a1abd18 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-91c8c32e-03ef-46c3-8122-6bb424bdcb9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:26.989373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:26.990368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:26.991287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:26.991287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:26.991287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:26.991287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:26.991287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 529/1067] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:26.991886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8c32e-03ef-46c3-8122-6bb424bdcb9d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.027074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8cbc-e92f-4597-8fcd-9f86c3c6a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.027965 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8cbc-e92f-4597-8fcd-9f86c3c6a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.028251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8cbc-e92f-4597-8fcd-9f86c3c6a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.028524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc8cbc-e92f-4597-8fcd-9f86c3c6a7a7 None admin] PATH_INFO: `/v3/projects/e743e713556f47a59b66e501ea945716` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.029799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc8cbc-e92f-4597-8fcd-9f86c3c6a7a7 None admin] RBAC: Authorizing `identity:get_project(project_id=e743e713556f47a59b66e501ea945716)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.031257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc8cbc-e92f-4597-8fcd-9f86c3c6a7a7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.033715 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 539/1068] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:26 2022] GET /identity/v3/projects/e743e713556f47a59b66e501ea945716 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:27.034914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8cbc-e92f-4597-8fcd-9f86c3c6a7a7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.093091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8c32e-03ef-46c3-8122-6bb424bdcb9d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:27.126356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c56f9c-7ba0-4fa7-bc71-6d48aba5a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.127046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c56f9c-7ba0-4fa7-bc71-6d48aba5a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.127324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c56f9c-7ba0-4fa7-bc71-6d48aba5a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.127614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c56f9c-7ba0-4fa7-bc71-6d48aba5a9c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.133158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:27.134853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c56f9c-7ba0-4fa7-bc71-6d48aba5a9c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.136013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc8cbc-e92f-4597-8fcd-9f86c3c6a7a7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:27.136317 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c56f9c-7ba0-4fa7-bc71-6d48aba5a9c0 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-17c56f9c-7ba0-4fa7-bc71-6d48aba5a9c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:27.151461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:27.152647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 530/1069] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 2 09:55:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:27.154014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c56f9c-7ba0-4fa7-bc71-6d48aba5a9c0 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.172073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d23d2d-63ae-42cd-b44e-5e0b6fbca871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.172789 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23d2d-63ae-42cd-b44e-5e0b6fbca871 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.173079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23d2d-63ae-42cd-b44e-5e0b6fbca871 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.173403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23d2d-63ae-42cd-b44e-5e0b6fbca871 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.174155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d23d2d-63ae-42cd-b44e-5e0b6fbca871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:27.174467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d23d2d-63ae-42cd-b44e-5e0b6fbca871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.175932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d23d2d-63ae-42cd-b44e-5e0b6fbca871 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.187531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 540/1070] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:27.188835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d23d2d-63ae-42cd-b44e-5e0b6fbca871 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.210779 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:27.269245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c56f9c-7ba0-4fa7-bc71-6d48aba5a9c0 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:27.308942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631789a-199a-4495-8405-329052d3b12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.309628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631789a-199a-4495-8405-329052d3b12c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.309915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631789a-199a-4495-8405-329052d3b12c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.310197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631789a-199a-4495-8405-329052d3b12c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.310449 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d23d2d-63ae-42cd-b44e-5e0b6fbca871 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:27.311049 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631789a-199a-4495-8405-329052d3b12c None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=e743e713556f47a59b66e501ea945716, user.id=ddb93e7597c143c9a81ab9d3cae2435c) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:27.311370 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631789a-199a-4495-8405-329052d3b12c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.312884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631789a-199a-4495-8405-329052d3b12c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.319858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 531/1071] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/role_assignments?user.id=ddb93e7597c143c9a81ab9d3cae2435c&scope.project.id=e743e713556f47a59b66e501ea945716&role.id=918b179f19b6437493eabe5394fa9af0 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:27.363387 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e56400-3da8-44b3-a209-a813ea6b2974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.364124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e56400-3da8-44b3-a209-a813ea6b2974 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.364410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e56400-3da8-44b3-a209-a813ea6b2974 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.364686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e56400-3da8-44b3-a209-a813ea6b2974 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.365566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e56400-3da8-44b3-a209-a813ea6b2974 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:27.365884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e56400-3da8-44b3-a209-a813ea6b2974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.367386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e56400-3da8-44b3-a209-a813ea6b2974 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.388467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 541/1072] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:27.394191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631789a-199a-4495-8405-329052d3b12c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.508990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631789a-199a-4495-8405-329052d3b12c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:27.525949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:27.547011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f609fa-10d1-41c5-a530-eaf2a2fc67fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.548812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f609fa-10d1-41c5-a530-eaf2a2fc67fd None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.548812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f609fa-10d1-41c5-a530-eaf2a2fc67fd None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.548996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f609fa-10d1-41c5-a530-eaf2a2fc67fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.559246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f609fa-10d1-41c5-a530-eaf2a2fc67fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.560733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f609fa-10d1-41c5-a530-eaf2a2fc67fd None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-f9f609fa-10d1-41c5-a530-eaf2a2fc67fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:27.578501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:27.580269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:27.581178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:27.581178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:27.581178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:27.581178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:27.581178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 532/1073] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:27.591310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e56400-3da8-44b3-a209-a813ea6b2974 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.611095 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:27.691802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e56400-3da8-44b3-a209-a813ea6b2974 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:27.726473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabf376-82b5-4318-86c0-b01623c611f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.727134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf376-82b5-4318-86c0-b01623c611f9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.727418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf376-82b5-4318-86c0-b01623c611f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.727726 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf376-82b5-4318-86c0-b01623c611f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.728450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabf376-82b5-4318-86c0-b01623c611f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:27.728763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabf376-82b5-4318-86c0-b01623c611f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.730118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabf376-82b5-4318-86c0-b01623c611f9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.741892 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 542/1074] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:27.747421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f609fa-10d1-41c5-a530-eaf2a2fc67fd None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.846460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f609fa-10d1-41c5-a530-eaf2a2fc67fd None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:27.881522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8f91e-f5b5-4346-9fba-b5a892be3b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:27.882316 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8f91e-f5b5-4346-9fba-b5a892be3b3b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:27.882599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8f91e-f5b5-4346-9fba-b5a892be3b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:27.882876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8f91e-f5b5-4346-9fba-b5a892be3b3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:27.889614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8f91e-f5b5-4346-9fba-b5a892be3b3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:27.891048 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8f91e-f5b5-4346-9fba-b5a892be3b3b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-adc8f91e-f5b5-4346-9fba-b5a892be3b3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:27.905438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:27.906444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:27.907461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:27.907461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:27.907461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:27.907461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:27.907461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:27.907461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:27.907461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:27.907461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:27.907461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 533/1075] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:27.912522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabf376-82b5-4318-86c0-b01623c611f9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:27.989287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:28.010253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabf376-82b5-4318-86c0-b01623c611f9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:28.043913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd5b04-8110-4a48-945d-ffa790843483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:28.044570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5b04-8110-4a48-945d-ffa790843483 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.044855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5b04-8110-4a48-945d-ffa790843483 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.045133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd5b04-8110-4a48-945d-ffa790843483 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.045922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd5b04-8110-4a48-945d-ffa790843483 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:28.046234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd5b04-8110-4a48-945d-ffa790843483 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:28.047744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd5b04-8110-4a48-945d-ffa790843483 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:28.059864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 543/1076] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:28.066598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8f91e-f5b5-4346-9fba-b5a892be3b3b None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:28.094603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:28.167026 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8f91e-f5b5-4346-9fba-b5a892be3b3b None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:28.200190 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303763b-f0c5-412c-9daf-2834b73d6344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:28.201061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303763b-f0c5-412c-9daf-2834b73d6344 None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:28.201341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303763b-f0c5-412c-9daf-2834b73d6344 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:28.201615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303763b-f0c5-412c-9daf-2834b73d6344 None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/ba690590103a4019a56b191e8dfe3231/roles/009e0d0f2e644f589ccc0490f465ffa8` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:28.203780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303763b-f0c5-412c-9daf-2834b73d6344 None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=ba690590103a4019a56b191e8dfe3231, role_id=009e0d0f2e644f589ccc0490f465ffa8)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:28.205234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303763b-f0c5-412c-9daf-2834b73d6344 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:28.278739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 534/1077] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:55:28 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/ba690590103a4019a56b191e8dfe3231/roles/009e0d0f2e644f589ccc0490f465ffa8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:55:29.589887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cc7fa-61b5-4371-8eeb-71d201478063 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:29.590438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cc7fa-61b5-4371-8eeb-71d201478063 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:29.590543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cc7fa-61b5-4371-8eeb-71d201478063 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:29.591872 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 544/1078] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:29.597256 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7210e8d-ed5f-4513-92a4-861957629303 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:29.597643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7210e8d-ed5f-4513-92a4-861957629303 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:29.597945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7210e8d-ed5f-4513-92a4-861957629303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:29.615200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e7210e8d-ed5f-4513-92a4-861957629303 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:29.616441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e7210e8d-ed5f-4513-92a4-861957629303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:29.683393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 535/1079] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:29.707481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cc7fa-61b5-4371-8eeb-71d201478063 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:29.808272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cc7fa-61b5-4371-8eeb-71d201478063 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:29.844320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07db01-0436-48f6-9920-9402d7dff0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:29.845582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07db01-0436-48f6-9920-9402d7dff0af None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:29.845863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07db01-0436-48f6-9920-9402d7dff0af None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:29.846137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07db01-0436-48f6-9920-9402d7dff0af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:29.853205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:29.856879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d07db01-0436-48f6-9920-9402d7dff0af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2d07db01-0436-48f6-9920-9402d7dff0af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:29.864709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:29.865687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:29.866554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 545/1080] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:29.872065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7210e8d-ed5f-4513-92a4-861957629303 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:29.890349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:29.974459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7210e8d-ed5f-4513-92a4-861957629303 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:30.008751 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad0ceb-2195-41c4-9485-1f4aa947c390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:30.009369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0ceb-2195-41c4-9485-1f4aa947c390 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.009655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0ceb-2195-41c4-9485-1f4aa947c390 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.009934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0ceb-2195-41c4-9485-1f4aa947c390 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.010680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad0ceb-2195-41c4-9485-1f4aa947c390 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:30.010989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad0ceb-2195-41c4-9485-1f4aa947c390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:30.012381 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad0ceb-2195-41c4-9485-1f4aa947c390 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:30.021054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 536/1081] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:30.027267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07db01-0436-48f6-9920-9402d7dff0af None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:30.126473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07db01-0436-48f6-9920-9402d7dff0af None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:30.160792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e1300-65a1-4cce-8241-ec49a15b4fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:30.161691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e1300-65a1-4cce-8241-ec49a15b4fba None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.161974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e1300-65a1-4cce-8241-ec49a15b4fba None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.162252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e1300-65a1-4cce-8241-ec49a15b4fba None admin] PATH_INFO: `/v3/users/ddb93e7597c143c9a81ab9d3cae2435c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.163548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e1300-65a1-4cce-8241-ec49a15b4fba None admin] RBAC: Authorizing `identity:get_user(user_id=ddb93e7597c143c9a81ab9d3cae2435c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:30.165056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e1300-65a1-4cce-8241-ec49a15b4fba None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:30.166805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 546/1082] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:30 2022] GET /identity/v3/users/ddb93e7597c143c9a81ab9d3cae2435c => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:30.172918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad0ceb-2195-41c4-9485-1f4aa947c390 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:30.251383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:30.272483 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad0ceb-2195-41c4-9485-1f4aa947c390 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:30.307343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac14c0-7847-4a73-9aa9-5024250467f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:30.308231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac14c0-7847-4a73-9aa9-5024250467f9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.308514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac14c0-7847-4a73-9aa9-5024250467f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.308791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac14c0-7847-4a73-9aa9-5024250467f9 None admin] PATH_INFO: `/v3/projects/e743e713556f47a59b66e501ea945716` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.309964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac14c0-7847-4a73-9aa9-5024250467f9 None admin] RBAC: Authorizing `identity:get_project(project_id=e743e713556f47a59b66e501ea945716)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:30.311384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac14c0-7847-4a73-9aa9-5024250467f9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:30.313184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 537/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:30 2022] GET /identity/v3/projects/e743e713556f47a59b66e501ea945716 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:30.319625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e1300-65a1-4cce-8241-ec49a15b4fba None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:30.383597 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:30.419337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e1300-65a1-4cce-8241-ec49a15b4fba None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:30.452144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc3d85-b81c-417b-8cf5-edaa484f4503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:30.453032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc3d85-b81c-417b-8cf5-edaa484f4503 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.453319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc3d85-b81c-417b-8cf5-edaa484f4503 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.453594 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc3d85-b81c-417b-8cf5-edaa484f4503 None admin] PATH_INFO: `/v3/projects/e743e713556f47a59b66e501ea945716/users/ddb93e7597c143c9a81ab9d3cae2435c/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.456232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc3d85-b81c-417b-8cf5-edaa484f4503 None admin] RBAC: Authorizing `identity:create_grant(project_id=e743e713556f47a59b66e501ea945716, user_id=ddb93e7597c143c9a81ab9d3cae2435c, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:30.457659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc3d85-b81c-417b-8cf5-edaa484f4503 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:30.492291 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31523c72-faef-4bc8-b0e8-f96ac9c45d48 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.492604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31523c72-faef-4bc8-b0e8-f96ac9c45d48 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.492880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31523c72-faef-4bc8-b0e8-f96ac9c45d48 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.494246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 538/1084] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 09:55:30.498840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48011fb-49d8-4801-8bfe-7ac2a4300a59 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.499125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48011fb-49d8-4801-8bfe-7ac2a4300a59 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.499402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48011fb-49d8-4801-8bfe-7ac2a4300a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.515989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f48011fb-49d8-4801-8bfe-7ac2a4300a59 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:30.517867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f48011fb-49d8-4801-8bfe-7ac2a4300a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:30.525215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 547/1085] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:55:30 2022] PUT /identity/v3/projects/e743e713556f47a59b66e501ea945716/users/ddb93e7597c143c9a81ab9d3cae2435c/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:55:30.591236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 539/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:30.616402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc3d85-b81c-417b-8cf5-edaa484f4503 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:30.725004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc3d85-b81c-417b-8cf5-edaa484f4503 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:30.750413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:30.758645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3b76a-927b-4b3c-99ac-602dc6bb9866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:30.763010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3b76a-927b-4b3c-99ac-602dc6bb9866 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.763010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3b76a-927b-4b3c-99ac-602dc6bb9866 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.763010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3b76a-927b-4b3c-99ac-602dc6bb9866 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.770898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3b76a-927b-4b3c-99ac-602dc6bb9866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-d4b3b76a-927b-4b3c-99ac-602dc6bb9866 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:30.779380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:30.780628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:30.781511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 548/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jun 2 09:55:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:30.787092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48011fb-49d8-4801-8bfe-7ac2a4300a59 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:30.865056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:30.887469 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48011fb-49d8-4801-8bfe-7ac2a4300a59 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:30.921139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4151-fd37-46b1-8e0d-7963e1141834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:30.921816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4151-fd37-46b1-8e0d-7963e1141834 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:30.922100 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4151-fd37-46b1-8e0d-7963e1141834 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:30.922377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4151-fd37-46b1-8e0d-7963e1141834 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:30.923842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4151-fd37-46b1-8e0d-7963e1141834 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:30.924152 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4151-fd37-46b1-8e0d-7963e1141834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:30.925519 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4151-fd37-46b1-8e0d-7963e1141834 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:30.933393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 540/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 2 09:55:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:30.939126 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3b76a-927b-4b3c-99ac-602dc6bb9866 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:31.036936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3b76a-927b-4b3c-99ac-602dc6bb9866 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:31.070372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f88dd1-9c51-4441-87f9-1bb5786f8d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:31.071153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88dd1-9c51-4441-87f9-1bb5786f8d88 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.071436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88dd1-9c51-4441-87f9-1bb5786f8d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.071748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f88dd1-9c51-4441-87f9-1bb5786f8d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.082236 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f88dd1-9c51-4441-87f9-1bb5786f8d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:31.083773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f88dd1-9c51-4441-87f9-1bb5786f8d88 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-53f88dd1-9c51-4441-87f9-1bb5786f8d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:31.101393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:31.102371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:31.103312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:31.103312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:31.103312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:31.103312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:31.103312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 549/1089] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:55:31.108229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4151-fd37-46b1-8e0d-7963e1141834 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:31.209075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4151-fd37-46b1-8e0d-7963e1141834 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:31.241787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858102e-7105-4b2c-811f-67ebe3c1cd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:31.242448 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858102e-7105-4b2c-811f-67ebe3c1cd17 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.242735 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858102e-7105-4b2c-811f-67ebe3c1cd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.243014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858102e-7105-4b2c-811f-67ebe3c1cd17 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.243768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858102e-7105-4b2c-811f-67ebe3c1cd17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:31.244079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858102e-7105-4b2c-811f-67ebe3c1cd17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:31.245434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858102e-7105-4b2c-811f-67ebe3c1cd17 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:31.252892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:31.258067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 541/1090] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:31.263666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f88dd1-9c51-4441-87f9-1bb5786f8d88 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:31.303681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:31.362383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f88dd1-9c51-4441-87f9-1bb5786f8d88 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:31.394449 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29389de4-6e6e-4c48-96a1-43c0851e7fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:31.395222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29389de4-6e6e-4c48-96a1-43c0851e7fca None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.395504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29389de4-6e6e-4c48-96a1-43c0851e7fca None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.395807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29389de4-6e6e-4c48-96a1-43c0851e7fca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.403146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29389de4-6e6e-4c48-96a1-43c0851e7fca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:31.404600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29389de4-6e6e-4c48-96a1-43c0851e7fca None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-29389de4-6e6e-4c48-96a1-43c0851e7fca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:55:31.418340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:31.419502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:31.420521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:31.420521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:31.420521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:55:31.420521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:55:31.420521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:55:31.420521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:55:31.420521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:55:31.420521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:55:31.420521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 09:55:31.420521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:31.420521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 550/1091] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jun 2 09:55:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:31.425829 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858102e-7105-4b2c-811f-67ebe3c1cd17 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:31.521305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858102e-7105-4b2c-811f-67ebe3c1cd17 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:31.554803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841fd9d-b6c0-47c1-9570-6cb2d0f93dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:31.555398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841fd9d-b6c0-47c1-9570-6cb2d0f93dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.555718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841fd9d-b6c0-47c1-9570-6cb2d0f93dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.556000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841fd9d-b6c0-47c1-9570-6cb2d0f93dc9 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.556826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841fd9d-b6c0-47c1-9570-6cb2d0f93dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:31.557139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841fd9d-b6c0-47c1-9570-6cb2d0f93dc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:31.558553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841fd9d-b6c0-47c1-9570-6cb2d0f93dc9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:31.576231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 542/1092] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jun 2 09:55:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:31.581687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29389de4-6e6e-4c48-96a1-43c0851e7fca None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:31.677747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:31.681431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29389de4-6e6e-4c48-96a1-43c0851e7fca None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:31.713079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e5698-f35f-44a6-8e75-90bb5bc76426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:31.713721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e5698-f35f-44a6-8e75-90bb5bc76426 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:31.714001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e5698-f35f-44a6-8e75-90bb5bc76426 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:31.714273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e5698-f35f-44a6-8e75-90bb5bc76426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:31.780283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e5698-f35f-44a6-8e75-90bb5bc76426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:31.782252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e5698-f35f-44a6-8e75-90bb5bc76426 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:31.876697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:31.883028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 551/1093] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 09:55:31.888769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841fd9d-b6c0-47c1-9570-6cb2d0f93dc9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:31.943763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:31.986902 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841fd9d-b6c0-47c1-9570-6cb2d0f93dc9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:32.019357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714e3f8-24b5-4997-bb11-68f812773ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:32.020168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714e3f8-24b5-4997-bb11-68f812773ecb None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:32.020453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714e3f8-24b5-4997-bb11-68f812773ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:32.020731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714e3f8-24b5-4997-bb11-68f812773ecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:32.030630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714e3f8-24b5-4997-bb11-68f812773ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:32.032738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714e3f8-24b5-4997-bb11-68f812773ecb None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-4714e3f8-24b5-4997-bb11-68f812773ecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:55:32.049569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:32.050638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:32.051685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:55:32.051685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:55:32.051685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:55:32.051685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:32.051685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 543/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:32.056386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e5698-f35f-44a6-8e75-90bb5bc76426 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:32.155949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e5698-f35f-44a6-8e75-90bb5bc76426 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:32.189234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16909513-7f62-413c-9878-3280d52182f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:32.189887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16909513-7f62-413c-9878-3280d52182f9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:32.190171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16909513-7f62-413c-9878-3280d52182f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:32.190446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16909513-7f62-413c-9878-3280d52182f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:32.191173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16909513-7f62-413c-9878-3280d52182f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:32.191481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16909513-7f62-413c-9878-3280d52182f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:32.192863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16909513-7f62-413c-9878-3280d52182f9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:32.204763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 552/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:32.210143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714e3f8-24b5-4997-bb11-68f812773ecb None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:32.308884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714e3f8-24b5-4997-bb11-68f812773ecb None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:32.318107 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:32.341947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0ac57-18fe-4e44-934d-b1b2b8ba390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:32.342738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0ac57-18fe-4e44-934d-b1b2b8ba390f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:32.343023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0ac57-18fe-4e44-934d-b1b2b8ba390f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:32.343302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0ac57-18fe-4e44-934d-b1b2b8ba390f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:32.350514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0ac57-18fe-4e44-934d-b1b2b8ba390f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:32.352328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0ac57-18fe-4e44-934d-b1b2b8ba390f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-c3d0ac57-18fe-4e44-934d-b1b2b8ba390f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:55:32.366928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:32.368065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:32.369025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:55:32.369025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:55:32.369025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:55:32.369025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:55:32.369025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:55:32.369025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:55:32.369025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:55:32.369025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:55:32.369025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 544/1096] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:55:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:32.373911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16909513-7f62-413c-9878-3280d52182f9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:32.431458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:32.476272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16909513-7f62-413c-9878-3280d52182f9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:32.510949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e4940-5f1b-47b4-8c27-d5cefd9b8c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:32.511628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4940-5f1b-47b4-8c27-d5cefd9b8c48 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:32.511917 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4940-5f1b-47b4-8c27-d5cefd9b8c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:32.512191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e4940-5f1b-47b4-8c27-d5cefd9b8c48 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:32.512974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e4940-5f1b-47b4-8c27-d5cefd9b8c48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:32.513282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e4940-5f1b-47b4-8c27-d5cefd9b8c48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:32.514699 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e4940-5f1b-47b4-8c27-d5cefd9b8c48 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:32.526807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 553/1097] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:55:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:32.533748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0ac57-18fe-4e44-934d-b1b2b8ba390f None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:32.635321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0ac57-18fe-4e44-934d-b1b2b8ba390f None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:32.669656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e223e4c-2452-4bc9-9dfa-eb10f4c3782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:32.670311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223e4c-2452-4bc9-9dfa-eb10f4c3782b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:32.670605 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223e4c-2452-4bc9-9dfa-eb10f4c3782b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:32.670883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e223e4c-2452-4bc9-9dfa-eb10f4c3782b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:32.671748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e223e4c-2452-4bc9-9dfa-eb10f4c3782b None admin] RBAC: Adding query filter params (role.id=009e0d0f2e644f589ccc0490f465ffa8, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=ba690590103a4019a56b191e8dfe3231) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:32.672067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e223e4c-2452-4bc9-9dfa-eb10f4c3782b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:32.674396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e223e4c-2452-4bc9-9dfa-eb10f4c3782b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:32.680191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 545/1098] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:32 2022] GET /identity/v3/role_assignments?user.id=ba690590103a4019a56b191e8dfe3231&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=009e0d0f2e644f589ccc0490f465ffa8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:55:32.802603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f30a60-0c7b-4340-a395-39d75e47b6ea None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:32.803146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f30a60-0c7b-4340-a395-39d75e47b6ea None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:32.803146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f30a60-0c7b-4340-a395-39d75e47b6ea None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:32.804561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 554/1099] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:32.810235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e06128-1a5b-4892-b735-742041440455 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:32.810527 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e06128-1a5b-4892-b735-742041440455 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:32.810811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e06128-1a5b-4892-b735-742041440455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:32.829990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-24e06128-1a5b-4892-b735-742041440455 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:32.831208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-24e06128-1a5b-4892-b735-742041440455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:32.862626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:32.905351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 546/1100] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:32.930121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f30a60-0c7b-4340-a395-39d75e47b6ea None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:33.037846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f30a60-0c7b-4340-a395-39d75e47b6ea None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:33.055838 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:33.071956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98c1e-320d-48d3-a3b5-ca5c48915353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:33.072745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98c1e-320d-48d3-a3b5-ca5c48915353 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:33.073028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98c1e-320d-48d3-a3b5-ca5c48915353 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:33.079074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98c1e-320d-48d3-a3b5-ca5c48915353 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:33.083515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f98c1e-320d-48d3-a3b5-ca5c48915353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-64f98c1e-320d-48d3-a3b5-ca5c48915353 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:33.091644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:33.092614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:33.093488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:33.095307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 555/1101] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:33.099795 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e06128-1a5b-4892-b735-742041440455 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:33.203306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e06128-1a5b-4892-b735-742041440455 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:33.240710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1de05-9423-41d5-afb2-124f3cffc54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:33.241390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1de05-9423-41d5-afb2-124f3cffc54b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:33.241677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1de05-9423-41d5-afb2-124f3cffc54b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:33.241957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1de05-9423-41d5-afb2-124f3cffc54b None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:33.242711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1de05-9423-41d5-afb2-124f3cffc54b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:33.243034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1de05-9423-41d5-afb2-124f3cffc54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:33.244460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1de05-9423-41d5-afb2-124f3cffc54b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:33.253936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 547/1102] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:33.260057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98c1e-320d-48d3-a3b5-ca5c48915353 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:33.369224 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98c1e-320d-48d3-a3b5-ca5c48915353 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:33.404965 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c200cf7-088c-47c9-8ad7-b1426b86834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:33.405835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c200cf7-088c-47c9-8ad7-b1426b86834c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:33.406117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c200cf7-088c-47c9-8ad7-b1426b86834c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:33.406393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c200cf7-088c-47c9-8ad7-b1426b86834c None admin] PATH_INFO: `/v3/users/ddb93e7597c143c9a81ab9d3cae2435c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:33.407781 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c200cf7-088c-47c9-8ad7-b1426b86834c None admin] RBAC: Authorizing `identity:get_user(user_id=ddb93e7597c143c9a81ab9d3cae2435c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:33.409221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c200cf7-088c-47c9-8ad7-b1426b86834c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:33.410869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 556/1103] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:33 2022] GET /identity/v3/users/ddb93e7597c143c9a81ab9d3cae2435c => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:33.416840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1de05-9423-41d5-afb2-124f3cffc54b None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:33.446810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:33.522927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1de05-9423-41d5-afb2-124f3cffc54b None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:33.560030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bb6b8-3cb2-4966-b32f-f1e38a80ce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:33.560685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bb6b8-3cb2-4966-b32f-f1e38a80ce82 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:33.560967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bb6b8-3cb2-4966-b32f-f1e38a80ce82 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:33.561241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635bb6b8-3cb2-4966-b32f-f1e38a80ce82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:33.628298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635bb6b8-3cb2-4966-b32f-f1e38a80ce82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:33.629663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635bb6b8-3cb2-4966-b32f-f1e38a80ce82 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:33.652346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:33.724770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 548/1104] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:33.730588 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c200cf7-088c-47c9-8ad7-b1426b86834c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:33.776294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:33.828193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c200cf7-088c-47c9-8ad7-b1426b86834c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:33.861185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7237c-10f6-46d1-a547-afad3fafdf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:33.862040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7237c-10f6-46d1-a547-afad3fafdf82 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:33.862327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7237c-10f6-46d1-a547-afad3fafdf82 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:33.862606 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7237c-10f6-46d1-a547-afad3fafdf82 None admin] PATH_INFO: `/v3/projects/e743e713556f47a59b66e501ea945716` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:33.863827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7237c-10f6-46d1-a547-afad3fafdf82 None admin] RBAC: Authorizing `identity:get_project(project_id=e743e713556f47a59b66e501ea945716)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:33.865267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7237c-10f6-46d1-a547-afad3fafdf82 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:33.866976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 557/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:33 2022] GET /identity/v3/projects/e743e713556f47a59b66e501ea945716 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:33.873140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bb6b8-3cb2-4966-b32f-f1e38a80ce82 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:33.970443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635bb6b8-3cb2-4966-b32f-f1e38a80ce82 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:33.992509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:34.003144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10057-e3b8-4fb2-b241-8208f93e3a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:34.003816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10057-e3b8-4fb2-b241-8208f93e3a51 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:34.004104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10057-e3b8-4fb2-b241-8208f93e3a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:34.004382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10057-e3b8-4fb2-b241-8208f93e3a51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:34.005211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10057-e3b8-4fb2-b241-8208f93e3a51 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=e743e713556f47a59b66e501ea945716, user.id=ddb93e7597c143c9a81ab9d3cae2435c) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:34.005528 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10057-e3b8-4fb2-b241-8208f93e3a51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:34.007015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10057-e3b8-4fb2-b241-8208f93e3a51 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:34.012612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 549/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:33 2022] GET /identity/v3/role_assignments?user.id=ddb93e7597c143c9a81ab9d3cae2435c&scope.project.id=e743e713556f47a59b66e501ea945716&role.id=918b179f19b6437493eabe5394fa9af0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:36.257589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b710e8e-bf3b-4b7b-b542-518493394824 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.258088 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b710e8e-bf3b-4b7b-b542-518493394824 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.258088 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b710e8e-bf3b-4b7b-b542-518493394824 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.259432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 558/1107] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:36.264812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc044-7d44-4ede-8108-17a608a28eb3 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.265246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc044-7d44-4ede-8108-17a608a28eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.265364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc044-7d44-4ede-8108-17a608a28eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.282563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-33bfc044-7d44-4ede-8108-17a608a28eb3 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:36.283760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-33bfc044-7d44-4ede-8108-17a608a28eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:36.347201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 550/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 09:55:36.372473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b710e8e-bf3b-4b7b-b542-518493394824 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:36.471841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b710e8e-bf3b-4b7b-b542-518493394824 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:36.484698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:36.505477 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c963123-fd4d-4279-ac7b-e998d180423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:36.506255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c963123-fd4d-4279-ac7b-e998d180423a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.506539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c963123-fd4d-4279-ac7b-e998d180423a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.506815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c963123-fd4d-4279-ac7b-e998d180423a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.508060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c963123-fd4d-4279-ac7b-e998d180423a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:36.509500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c963123-fd4d-4279-ac7b-e998d180423a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:36.511217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 559/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:36.517005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc044-7d44-4ede-8108-17a608a28eb3 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:36.613561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc044-7d44-4ede-8108-17a608a28eb3 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:36.630315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:36.647054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68508d9-890b-4b15-bff6-de39dc6185db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:36.647743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68508d9-890b-4b15-bff6-de39dc6185db None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:36.648032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68508d9-890b-4b15-bff6-de39dc6185db None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:36.648312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68508d9-890b-4b15-bff6-de39dc6185db None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:36.649019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68508d9-890b-4b15-bff6-de39dc6185db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:36.650702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68508d9-890b-4b15-bff6-de39dc6185db None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:36.739294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 551/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:55:36 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:39.006217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512e5fd-ebf8-4af8-857d-b3250aee35de None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.006736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512e5fd-ebf8-4af8-857d-b3250aee35de None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.006736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512e5fd-ebf8-4af8-857d-b3250aee35de None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.008266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 560/1111] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:39.013431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc8ed9-eb0c-474a-b83d-a9e3e30c58ce None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.013825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc8ed9-eb0c-474a-b83d-a9e3e30c58ce None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.013983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc8ed9-eb0c-474a-b83d-a9e3e30c58ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.032358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-8afc8ed9-eb0c-474a-b83d-a9e3e30c58ce None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:39.033542 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8afc8ed9-eb0c-474a-b83d-a9e3e30c58ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:39.099367 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 552/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:39.123061 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512e5fd-ebf8-4af8-857d-b3250aee35de None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.223175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512e5fd-ebf8-4af8-857d-b3250aee35de None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:39.255508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae1db5-c29f-484b-90c3-34e049177370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:39.256384 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae1db5-c29f-484b-90c3-34e049177370 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.256666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae1db5-c29f-484b-90c3-34e049177370 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.256940 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae1db5-c29f-484b-90c3-34e049177370 None admin] PATH_INFO: `/v3/roles/d98e80f5e9c34378bf50e810e4b8a210` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.258415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae1db5-c29f-484b-90c3-34e049177370 None admin] RBAC: Authorizing `identity:get_role(role_id=d98e80f5e9c34378bf50e810e4b8a210)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:39.259811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae1db5-c29f-484b-90c3-34e049177370 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:39.261175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 561/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/roles/d98e80f5e9c34378bf50e810e4b8a210 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:39.266830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc8ed9-eb0c-474a-b83d-a9e3e30c58ce None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.361210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc8ed9-eb0c-474a-b83d-a9e3e30c58ce None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:39.364065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:39.395385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ec649-2f18-4345-848e-c03ddf9ae55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:39.396218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ec649-2f18-4345-848e-c03ddf9ae55c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.396503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ec649-2f18-4345-848e-c03ddf9ae55c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.396802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ec649-2f18-4345-848e-c03ddf9ae55c None admin] PATH_INFO: `/v3/users/32e7a6c6dfff4814ad9f37310d071342` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.410675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ec649-2f18-4345-848e-c03ddf9ae55c None admin] RBAC: Authorizing `identity:get_user(user_id=32e7a6c6dfff4814ad9f37310d071342)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:39.412174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ec649-2f18-4345-848e-c03ddf9ae55c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:39.413810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 553/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/users/32e7a6c6dfff4814ad9f37310d071342 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:39.419527 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae1db5-c29f-484b-90c3-34e049177370 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.469702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:39.519148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae1db5-c29f-484b-90c3-34e049177370 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:39.552321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc2035-996c-466a-b271-f7e0ffdc0484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:39.552957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc2035-996c-466a-b271-f7e0ffdc0484 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.553237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc2035-996c-466a-b271-f7e0ffdc0484 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.553511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc2035-996c-466a-b271-f7e0ffdc0484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.617567 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc2035-996c-466a-b271-f7e0ffdc0484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:39.618994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc2035-996c-466a-b271-f7e0ffdc0484 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:39.664596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:39.712556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 562/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:39.718458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ec649-2f18-4345-848e-c03ddf9ae55c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.813698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ec649-2f18-4345-848e-c03ddf9ae55c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:39.847791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a72c8b-35b5-49c3-b255-1a39d489e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:39.848628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a72c8b-35b5-49c3-b255-1a39d489e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.848915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a72c8b-35b5-49c3-b255-1a39d489e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.849199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a72c8b-35b5-49c3-b255-1a39d489e7f6 None admin] PATH_INFO: `/v3/projects/e743e713556f47a59b66e501ea945716` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.850371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a72c8b-35b5-49c3-b255-1a39d489e7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=e743e713556f47a59b66e501ea945716)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:39.851814 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a72c8b-35b5-49c3-b255-1a39d489e7f6 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:39.853489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 554/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/projects/e743e713556f47a59b66e501ea945716 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:39.859475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc2035-996c-466a-b271-f7e0ffdc0484 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:39.954736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc2035-996c-466a-b271-f7e0ffdc0484 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:39.987239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f9f5e-af4b-4904-b36e-c727e2024a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:39.987904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9f5e-af4b-4904-b36e-c727e2024a04 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:39.988183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9f5e-af4b-4904-b36e-c727e2024a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:39.988453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f9f5e-af4b-4904-b36e-c727e2024a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:39.989266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f9f5e-af4b-4904-b36e-c727e2024a04 None admin] RBAC: Adding query filter params (role.id=d98e80f5e9c34378bf50e810e4b8a210, scope.project.id=e743e713556f47a59b66e501ea945716, user.id=32e7a6c6dfff4814ad9f37310d071342) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:39.989574 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f9f5e-af4b-4904-b36e-c727e2024a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:39.990989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f9f5e-af4b-4904-b36e-c727e2024a04 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:39.996304 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 563/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:39 2022] GET /identity/v3/role_assignments?user.id=32e7a6c6dfff4814ad9f37310d071342&scope.project.id=e743e713556f47a59b66e501ea945716&role.id=d98e80f5e9c34378bf50e810e4b8a210 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:42.210562 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b262c-2e8e-470a-a132-372b72988422 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:42.211066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b262c-2e8e-470a-a132-372b72988422 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:42.211066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b262c-2e8e-470a-a132-372b72988422 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:42.212438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 555/1118] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:42.217653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c82b9-1ef3-4415-b8ae-f8f251b225f8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:42.218037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c82b9-1ef3-4415-b8ae-f8f251b225f8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:42.218225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c82b9-1ef3-4415-b8ae-f8f251b225f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:42.235165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-709c82b9-1ef3-4415-b8ae-f8f251b225f8 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:42.236403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-709c82b9-1ef3-4415-b8ae-f8f251b225f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:42.246142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:42.302743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 564/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:42.325740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b262c-2e8e-470a-a132-372b72988422 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:42.355932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:42.424466 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b262c-2e8e-470a-a132-372b72988422 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:42.456663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5292aa-0c75-48f2-bd97-bf4ed1dd8440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:42.457499 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5292aa-0c75-48f2-bd97-bf4ed1dd8440 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:42.457784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5292aa-0c75-48f2-bd97-bf4ed1dd8440 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:42.458063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5292aa-0c75-48f2-bd97-bf4ed1dd8440 None admin] PATH_INFO: `/v3/roles/d98e80f5e9c34378bf50e810e4b8a210` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:42.459520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5292aa-0c75-48f2-bd97-bf4ed1dd8440 None admin] RBAC: Authorizing `identity:get_role(role_id=d98e80f5e9c34378bf50e810e4b8a210)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:42.460957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5292aa-0c75-48f2-bd97-bf4ed1dd8440 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:42.462260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 556/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:42 2022] GET /identity/v3/roles/d98e80f5e9c34378bf50e810e4b8a210 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:42.468100 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c82b9-1ef3-4415-b8ae-f8f251b225f8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:42.564729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c82b9-1ef3-4415-b8ae-f8f251b225f8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:42.598322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac20d1-aca0-41c4-8d2b-bbeca89a885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:42.599197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac20d1-aca0-41c4-8d2b-bbeca89a885d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:42.599484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac20d1-aca0-41c4-8d2b-bbeca89a885d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:42.599793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac20d1-aca0-41c4-8d2b-bbeca89a885d None admin] PATH_INFO: `/v3/users/32e7a6c6dfff4814ad9f37310d071342` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:42.600991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac20d1-aca0-41c4-8d2b-bbeca89a885d None admin] RBAC: Authorizing `identity:get_user(user_id=32e7a6c6dfff4814ad9f37310d071342)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:42.602425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac20d1-aca0-41c4-8d2b-bbeca89a885d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:42.604078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 565/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:42 2022] GET /identity/v3/users/32e7a6c6dfff4814ad9f37310d071342 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:42.609814 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5292aa-0c75-48f2-bd97-bf4ed1dd8440 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:42.703131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:42.707522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5292aa-0c75-48f2-bd97-bf4ed1dd8440 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:42.740141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c678b-b901-4cd1-9080-7075f47fdba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:42.740921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c678b-b901-4cd1-9080-7075f47fdba5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:42.741203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c678b-b901-4cd1-9080-7075f47fdba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:42.741479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c678b-b901-4cd1-9080-7075f47fdba5 None admin] PATH_INFO: `/v3/projects/e743e713556f47a59b66e501ea945716` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:42.742639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c678b-b901-4cd1-9080-7075f47fdba5 None admin] RBAC: Authorizing `identity:get_project(project_id=e743e713556f47a59b66e501ea945716)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:42.744092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c678b-b901-4cd1-9080-7075f47fdba5 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:42.745755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 557/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:42 2022] GET /identity/v3/projects/e743e713556f47a59b66e501ea945716 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:42.751555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac20d1-aca0-41c4-8d2b-bbeca89a885d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:42.766890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:42.852898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac20d1-aca0-41c4-8d2b-bbeca89a885d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:42.886908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0722-898e-46ca-865d-33af7f413831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:42.887890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0722-898e-46ca-865d-33af7f413831 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:42.888175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0722-898e-46ca-865d-33af7f413831 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:42.888451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0722-898e-46ca-865d-33af7f413831 None admin] PATH_INFO: `/v3/projects/e743e713556f47a59b66e501ea945716/users/32e7a6c6dfff4814ad9f37310d071342/roles/d98e80f5e9c34378bf50e810e4b8a210` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:42.890661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d0722-898e-46ca-865d-33af7f413831 None admin] RBAC: Authorizing `identity:create_grant(project_id=e743e713556f47a59b66e501ea945716, user_id=32e7a6c6dfff4814ad9f37310d071342, role_id=d98e80f5e9c34378bf50e810e4b8a210)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:42.892125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d0722-898e-46ca-865d-33af7f413831 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:42.951716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 566/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:55:42 2022] PUT /identity/v3/projects/e743e713556f47a59b66e501ea945716/users/32e7a6c6dfff4814ad9f37310d071342/roles/d98e80f5e9c34378bf50e810e4b8a210 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:55:45.178971 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4d97e-a17d-4433-ba04-46c3b2add465 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:45.179488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4d97e-a17d-4433-ba04-46c3b2add465 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:45.179488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4d97e-a17d-4433-ba04-46c3b2add465 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:45.180853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 558/1124] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:45.186082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c5ce7-96ca-4aef-9909-060eb1e9cebd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:45.186506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c5ce7-96ca-4aef-9909-060eb1e9cebd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:45.186637 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c5ce7-96ca-4aef-9909-060eb1e9cebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:45.203298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-dd2c5ce7-96ca-4aef-9909-060eb1e9cebd None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:45.204507 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-dd2c5ce7-96ca-4aef-9909-060eb1e9cebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:45.270859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 567/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:45.295251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4d97e-a17d-4433-ba04-46c3b2add465 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:45.393520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4d97e-a17d-4433-ba04-46c3b2add465 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:45.426315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde9806-1c55-4e5b-8a8a-0add5db896e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:45.427173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde9806-1c55-4e5b-8a8a-0add5db896e2 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:45.427459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde9806-1c55-4e5b-8a8a-0add5db896e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:45.427772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde9806-1c55-4e5b-8a8a-0add5db896e2 None admin] PATH_INFO: `/v3/roles/d98e80f5e9c34378bf50e810e4b8a210` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:45.429312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde9806-1c55-4e5b-8a8a-0add5db896e2 None admin] RBAC: Authorizing `identity:get_role(role_id=d98e80f5e9c34378bf50e810e4b8a210)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:45.430628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde9806-1c55-4e5b-8a8a-0add5db896e2 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:45.432028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 559/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:45 2022] GET /identity/v3/roles/d98e80f5e9c34378bf50e810e4b8a210 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:45.437784 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c5ce7-96ca-4aef-9909-060eb1e9cebd None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:45.440467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:45.536656 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c5ce7-96ca-4aef-9909-060eb1e9cebd None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:45.571797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d27a56-c254-4fd1-8c06-d1f8abd7ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:45.572682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27a56-c254-4fd1-8c06-d1f8abd7ec09 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:45.572969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27a56-c254-4fd1-8c06-d1f8abd7ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:45.573247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d27a56-c254-4fd1-8c06-d1f8abd7ec09 None admin] PATH_INFO: `/v3/users/32e7a6c6dfff4814ad9f37310d071342` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:45.574424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d27a56-c254-4fd1-8c06-d1f8abd7ec09 None admin] RBAC: Authorizing `identity:get_user(user_id=32e7a6c6dfff4814ad9f37310d071342)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:45.575898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d27a56-c254-4fd1-8c06-d1f8abd7ec09 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:45.579766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 568/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:45 2022] GET /identity/v3/users/32e7a6c6dfff4814ad9f37310d071342 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:45.583449 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde9806-1c55-4e5b-8a8a-0add5db896e2 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:45.617528 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:45.684502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde9806-1c55-4e5b-8a8a-0add5db896e2 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:45.718992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1d0ca-c349-448c-9797-6bf4c2b3288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:45.719797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d0ca-c349-448c-9797-6bf4c2b3288d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:45.720086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d0ca-c349-448c-9797-6bf4c2b3288d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:45.720364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1d0ca-c349-448c-9797-6bf4c2b3288d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:45.791192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1d0ca-c349-448c-9797-6bf4c2b3288d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:45.792682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1d0ca-c349-448c-9797-6bf4c2b3288d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:45.824881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:45.890788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 560/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:45.896745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d27a56-c254-4fd1-8c06-d1f8abd7ec09 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:45.966836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:45.997164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d27a56-c254-4fd1-8c06-d1f8abd7ec09 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:46.030701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94cc00-7f1d-4f77-b1ea-df3c07025503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:46.031542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94cc00-7f1d-4f77-b1ea-df3c07025503 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:46.031851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94cc00-7f1d-4f77-b1ea-df3c07025503 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:46.032130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94cc00-7f1d-4f77-b1ea-df3c07025503 None admin] PATH_INFO: `/v3/projects/e743e713556f47a59b66e501ea945716` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:46.033282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94cc00-7f1d-4f77-b1ea-df3c07025503 None admin] RBAC: Authorizing `identity:get_project(project_id=e743e713556f47a59b66e501ea945716)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:46.034697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94cc00-7f1d-4f77-b1ea-df3c07025503 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:46.036385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 569/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:45 2022] GET /identity/v3/projects/e743e713556f47a59b66e501ea945716 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:46.042412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1d0ca-c349-448c-9797-6bf4c2b3288d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:46.137958 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1d0ca-c349-448c-9797-6bf4c2b3288d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:46.170467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b5d90-c10a-4545-9eba-2daebae0e6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:46.171110 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b5d90-c10a-4545-9eba-2daebae0e6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:46.171393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b5d90-c10a-4545-9eba-2daebae0e6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:46.171697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b5d90-c10a-4545-9eba-2daebae0e6b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:46.172524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b5d90-c10a-4545-9eba-2daebae0e6b8 None admin] RBAC: Adding query filter params (role.id=d98e80f5e9c34378bf50e810e4b8a210, scope.project.id=e743e713556f47a59b66e501ea945716, user.id=32e7a6c6dfff4814ad9f37310d071342) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:46.172838 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b5d90-c10a-4545-9eba-2daebae0e6b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:46.174782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b5d90-c10a-4545-9eba-2daebae0e6b8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:46.176719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:46.181158 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 561/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:46 2022] GET /identity/v3/role_assignments?user.id=32e7a6c6dfff4814ad9f37310d071342&scope.project.id=e743e713556f47a59b66e501ea945716&role.id=d98e80f5e9c34378bf50e810e4b8a210 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:48.416007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc8261-c751-4897-bce8-280a140973e1 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:48.416572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc8261-c751-4897-bce8-280a140973e1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:48.416572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc8261-c751-4897-bce8-280a140973e1 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:48.417912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 570/1131] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:48.423069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c8ace-cdba-4959-aa7c-a5721a99c35b None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:48.423477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c8ace-cdba-4959-aa7c-a5721a99c35b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:48.423659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c8ace-cdba-4959-aa7c-a5721a99c35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:48.440208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-188c8ace-cdba-4959-aa7c-a5721a99c35b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:48.441392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-188c8ace-cdba-4959-aa7c-a5721a99c35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:48.504973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 562/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:48.528819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc8261-c751-4897-bce8-280a140973e1 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:48.626912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc8261-c751-4897-bce8-280a140973e1 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:48.660132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41970025-0ae7-4fb0-abeb-df900bde37d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:48.660906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970025-0ae7-4fb0-abeb-df900bde37d0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:48.661188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970025-0ae7-4fb0-abeb-df900bde37d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:48.661462 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970025-0ae7-4fb0-abeb-df900bde37d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:48.662623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41970025-0ae7-4fb0-abeb-df900bde37d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:48.664078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41970025-0ae7-4fb0-abeb-df900bde37d0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:48.665659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 571/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:48.671624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c8ace-cdba-4959-aa7c-a5721a99c35b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:48.768848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c8ace-cdba-4959-aa7c-a5721a99c35b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:48.793866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:48.801688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4221f2-8885-4269-bc2d-1edc8ecec4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:48.802342 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4221f2-8885-4269-bc2d-1edc8ecec4a3 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:48.802629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4221f2-8885-4269-bc2d-1edc8ecec4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:48.802908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4221f2-8885-4269-bc2d-1edc8ecec4a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:48.803630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4221f2-8885-4269-bc2d-1edc8ecec4a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:48.805055 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4221f2-8885-4269-bc2d-1edc8ecec4a3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:48.931605 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 563/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:55:48 2022] POST /identity/v3/projects => generated 311 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:51.248017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310f0e-1aae-4c8e-a998-245280976418 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:51.248520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310f0e-1aae-4c8e-a998-245280976418 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:51.248520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310f0e-1aae-4c8e-a998-245280976418 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:51.249889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 572/1135] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:51.255739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a87b66-47f1-4132-9520-b84a386fac8d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:51.256186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a87b66-47f1-4132-9520-b84a386fac8d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:51.256283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a87b66-47f1-4132-9520-b84a386fac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:51.273405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-98a87b66-47f1-4132-9520-b84a386fac8d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:51.274829 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-98a87b66-47f1-4132-9520-b84a386fac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:51.339306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 564/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:51.364305 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310f0e-1aae-4c8e-a998-245280976418 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:51.373147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:51.463592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310f0e-1aae-4c8e-a998-245280976418 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:51.496470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a88923-1671-4a36-8297-afdad4cbe2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:51.497236 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88923-1671-4a36-8297-afdad4cbe2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:51.497520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88923-1671-4a36-8297-afdad4cbe2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:51.497792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a88923-1671-4a36-8297-afdad4cbe2a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:51.498995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a88923-1671-4a36-8297-afdad4cbe2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:51.500411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a88923-1671-4a36-8297-afdad4cbe2a4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:51.502155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 573/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:55:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:51.507864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a87b66-47f1-4132-9520-b84a386fac8d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:51.602889 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a87b66-47f1-4132-9520-b84a386fac8d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:51.613071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:51.634816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7c493-320c-4c3f-a7c8-ddd607193f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:51.635472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c493-320c-4c3f-a7c8-ddd607193f3d None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:51.635781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c493-320c-4c3f-a7c8-ddd607193f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:51.636056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7c493-320c-4c3f-a7c8-ddd607193f3d None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:51.636800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7c493-320c-4c3f-a7c8-ddd607193f3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:51.638607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7c493-320c-4c3f-a7c8-ddd607193f3d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:51.740781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 565/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:55:51 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:55:54.006461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c395c-9c1c-4608-8c46-350b753276e0 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:54.006983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c395c-9c1c-4608-8c46-350b753276e0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:54.007073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c395c-9c1c-4608-8c46-350b753276e0 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:54.008415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 574/1139] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:54.013648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a8a8e-254d-4e7c-bdaf-995412ff41ac None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:54.014051 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a8a8e-254d-4e7c-bdaf-995412ff41ac None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:54.014210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a8a8e-254d-4e7c-bdaf-995412ff41ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:54.031618 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-2c6a8a8e-254d-4e7c-bdaf-995412ff41ac None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:54.032817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-2c6a8a8e-254d-4e7c-bdaf-995412ff41ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:54.097002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 566/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:54.120154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c395c-9c1c-4608-8c46-350b753276e0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:54.193943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:54.218618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c395c-9c1c-4608-8c46-350b753276e0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:54.251309 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15459a40-5651-4e37-a084-a5e1651df6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:54.252681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459a40-5651-4e37-a084-a5e1651df6ba None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:54.252967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459a40-5651-4e37-a084-a5e1651df6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:54.253246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459a40-5651-4e37-a084-a5e1651df6ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:54.262918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15459a40-5651-4e37-a084-a5e1651df6ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-15459a40-5651-4e37-a084-a5e1651df6ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:54.271117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:54.272226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:54.273269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 575/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:54.278510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a8a8e-254d-4e7c-bdaf-995412ff41ac None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:54.368402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:54.374003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a8a8e-254d-4e7c-bdaf-995412ff41ac None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:54.407633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea956b-34b9-4ea0-91c1-66c7dc269995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:54.408384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea956b-34b9-4ea0-91c1-66c7dc269995 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:54.408671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea956b-34b9-4ea0-91c1-66c7dc269995 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:54.408953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea956b-34b9-4ea0-91c1-66c7dc269995 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:54.409705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea956b-34b9-4ea0-91c1-66c7dc269995 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:54.410017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea956b-34b9-4ea0-91c1-66c7dc269995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:54.411408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea956b-34b9-4ea0-91c1-66c7dc269995 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:54.419274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 567/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:54.425591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15459a40-5651-4e37-a084-a5e1651df6ba None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:54.522513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15459a40-5651-4e37-a084-a5e1651df6ba None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:54.558690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43409b01-b86d-4b93-9ebc-53455e475c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:54.559737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43409b01-b86d-4b93-9ebc-53455e475c62 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:54.560074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43409b01-b86d-4b93-9ebc-53455e475c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:54.560394 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43409b01-b86d-4b93-9ebc-53455e475c62 None admin] PATH_INFO: `/v3/users/759ea23ff6364a9bbae4ee242bee061e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:54.562531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:54.576298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43409b01-b86d-4b93-9ebc-53455e475c62 None admin] RBAC: Authorizing `identity:get_user(user_id=759ea23ff6364a9bbae4ee242bee061e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:54.578134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43409b01-b86d-4b93-9ebc-53455e475c62 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:54.579924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 576/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:54 2022] GET /identity/v3/users/759ea23ff6364a9bbae4ee242bee061e => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:54.585673 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea956b-34b9-4ea0-91c1-66c7dc269995 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:54.685163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea956b-34b9-4ea0-91c1-66c7dc269995 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:54.717472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4b146-5834-443c-859e-f75858774541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:54.718115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4b146-5834-443c-859e-f75858774541 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:54.718403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4b146-5834-443c-859e-f75858774541 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:54.718688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4b146-5834-443c-859e-f75858774541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:54.745098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:54.787040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4b146-5834-443c-859e-f75858774541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:54.788514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4b146-5834-443c-859e-f75858774541 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:54.885018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 568/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:55:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:55:54.890748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43409b01-b86d-4b93-9ebc-53455e475c62 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:54.987608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43409b01-b86d-4b93-9ebc-53455e475c62 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:55.020837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a39b3-6bf9-497e-bd63-d48759cb7e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:55.021691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a39b3-6bf9-497e-bd63-d48759cb7e03 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:55.021974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a39b3-6bf9-497e-bd63-d48759cb7e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:55.022248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a39b3-6bf9-497e-bd63-d48759cb7e03 None admin] PATH_INFO: `/v3/projects/e050945db99f41a9b613c7d10c626fbe` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:55.023413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a39b3-6bf9-497e-bd63-d48759cb7e03 None admin] RBAC: Authorizing `identity:get_project(project_id=e050945db99f41a9b613c7d10c626fbe)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:55.025119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a39b3-6bf9-497e-bd63-d48759cb7e03 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:55.026777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 577/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:54 2022] GET /identity/v3/projects/e050945db99f41a9b613c7d10c626fbe => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:55.032774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4b146-5834-443c-859e-f75858774541 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:55.089732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:55.130231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4b146-5834-443c-859e-f75858774541 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:55.164058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93a6ed-9dce-483f-ae45-f8a71c930882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:55.164707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93a6ed-9dce-483f-ae45-f8a71c930882 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:55.164994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93a6ed-9dce-483f-ae45-f8a71c930882 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:55.165272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93a6ed-9dce-483f-ae45-f8a71c930882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:55.166099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93a6ed-9dce-483f-ae45-f8a71c930882 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=e050945db99f41a9b613c7d10c626fbe, user.id=759ea23ff6364a9bbae4ee242bee061e) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:55.166417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93a6ed-9dce-483f-ae45-f8a71c930882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:55.167864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa93a6ed-9dce-483f-ae45-f8a71c930882 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:55.173112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 569/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:55:55 2022] GET /identity/v3/role_assignments?user.id=759ea23ff6364a9bbae4ee242bee061e&scope.project.id=e050945db99f41a9b613c7d10c626fbe&role.id=918b179f19b6437493eabe5394fa9af0 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:57.369664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0db386-de88-4bb9-8c3a-3984f72b42fa None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:57.370214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0db386-de88-4bb9-8c3a-3984f72b42fa None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:57.370214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0db386-de88-4bb9-8c3a-3984f72b42fa None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:57.371628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 578/1147] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:55:57.377584 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f11a08-43ff-44bd-b84a-ca61ce459013 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:57.377995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f11a08-43ff-44bd-b84a-ca61ce459013 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:57.378133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f11a08-43ff-44bd-b84a-ca61ce459013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:57.394454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-82f11a08-43ff-44bd-b84a-ca61ce459013 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:55:57.395664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-82f11a08-43ff-44bd-b84a-ca61ce459013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:55:57.459998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 570/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:55:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:55:57.483019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0db386-de88-4bb9-8c3a-3984f72b42fa None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:57.542013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:57.582004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0db386-de88-4bb9-8c3a-3984f72b42fa None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:57.614411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ad309-42bf-4edb-a0c3-451c83e0d8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:57.615185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ad309-42bf-4edb-a0c3-451c83e0d8af None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:57.615466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ad309-42bf-4edb-a0c3-451c83e0d8af None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:57.615771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ad309-42bf-4edb-a0c3-451c83e0d8af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:57.625525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ad309-42bf-4edb-a0c3-451c83e0d8af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-249ad309-42bf-4edb-a0c3-451c83e0d8af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:55:57.633735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:55:57.634916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:55:57.636222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 579/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:55:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:55:57.640890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f11a08-43ff-44bd-b84a-ca61ce459013 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:57.692918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:57.738909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f11a08-43ff-44bd-b84a-ca61ce459013 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:57.772084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dccd9-0545-4f89-ae57-fec8db8d6b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:57.772741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dccd9-0545-4f89-ae57-fec8db8d6b2c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:57.773023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dccd9-0545-4f89-ae57-fec8db8d6b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:57.773320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745dccd9-0545-4f89-ae57-fec8db8d6b2c None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:57.774060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dccd9-0545-4f89-ae57-fec8db8d6b2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:55:57.774620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dccd9-0545-4f89-ae57-fec8db8d6b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:57.775997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745dccd9-0545-4f89-ae57-fec8db8d6b2c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:57.784545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 571/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:55:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:57.790373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ad309-42bf-4edb-a0c3-451c83e0d8af None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:57.889426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ad309-42bf-4edb-a0c3-451c83e0d8af None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:57.910212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:57.924723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08864a0-d27f-40b1-8059-cb93eb5d1688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:57.925591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08864a0-d27f-40b1-8059-cb93eb5d1688 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:57.925876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08864a0-d27f-40b1-8059-cb93eb5d1688 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:57.926155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08864a0-d27f-40b1-8059-cb93eb5d1688 None admin] PATH_INFO: `/v3/users/759ea23ff6364a9bbae4ee242bee061e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:57.927391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08864a0-d27f-40b1-8059-cb93eb5d1688 None admin] RBAC: Authorizing `identity:get_user(user_id=759ea23ff6364a9bbae4ee242bee061e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:57.928872 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08864a0-d27f-40b1-8059-cb93eb5d1688 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:57.930503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 580/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:55:57 2022] GET /identity/v3/users/759ea23ff6364a9bbae4ee242bee061e => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:57.936325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dccd9-0545-4f89-ae57-fec8db8d6b2c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:58.034430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745dccd9-0545-4f89-ae57-fec8db8d6b2c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:58.047332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:55:58.066050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd44bc-84dd-4fa3-9c2c-ea09a010ad9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:58.066897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd44bc-84dd-4fa3-9c2c-ea09a010ad9a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:58.067178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd44bc-84dd-4fa3-9c2c-ea09a010ad9a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:58.067453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd44bc-84dd-4fa3-9c2c-ea09a010ad9a None admin] PATH_INFO: `/v3/projects/e050945db99f41a9b613c7d10c626fbe` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:58.068627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd44bc-84dd-4fa3-9c2c-ea09a010ad9a None admin] RBAC: Authorizing `identity:get_project(project_id=e050945db99f41a9b613c7d10c626fbe)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:58.070083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd44bc-84dd-4fa3-9c2c-ea09a010ad9a None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:58.071941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 572/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:55:57 2022] GET /identity/v3/projects/e050945db99f41a9b613c7d10c626fbe => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:55:58.077861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08864a0-d27f-40b1-8059-cb93eb5d1688 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:55:58.175077 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08864a0-d27f-40b1-8059-cb93eb5d1688 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:55:58.207358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfe43b-1f89-44cc-9a91-ca8c3cd1b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:55:58.208250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe43b-1f89-44cc-9a91-ca8c3cd1b154 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:55:58.208533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe43b-1f89-44cc-9a91-ca8c3cd1b154 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:55:58.208806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfe43b-1f89-44cc-9a91-ca8c3cd1b154 None admin] PATH_INFO: `/v3/projects/e050945db99f41a9b613c7d10c626fbe/users/759ea23ff6364a9bbae4ee242bee061e/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:55:58.210724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfe43b-1f89-44cc-9a91-ca8c3cd1b154 None admin] RBAC: Authorizing `identity:create_grant(project_id=e050945db99f41a9b613c7d10c626fbe, user_id=759ea23ff6364a9bbae4ee242bee061e, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:55:58.212173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfe43b-1f89-44cc-9a91-ca8c3cd1b154 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:55:58.289543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 581/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:55:58 2022] PUT /identity/v3/projects/e050945db99f41a9b613c7d10c626fbe/users/759ea23ff6364a9bbae4ee242bee061e/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:56:00.497501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a32557-292e-48bf-afa8-294ef2ce454f None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:00.498050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a32557-292e-48bf-afa8-294ef2ce454f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:00.498050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a32557-292e-48bf-afa8-294ef2ce454f None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:00.499432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 573/1154] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:00.504645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40a7a-dd50-4430-aa03-8b5c78f27fed None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:00.505042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40a7a-dd50-4430-aa03-8b5c78f27fed None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:00.505207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40a7a-dd50-4430-aa03-8b5c78f27fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:00.522077 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0ae40a7a-dd50-4430-aa03-8b5c78f27fed None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:00.523253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0ae40a7a-dd50-4430-aa03-8b5c78f27fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:00.565127 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:00.587522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 582/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:00.611472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a32557-292e-48bf-afa8-294ef2ce454f None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:00.710213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a32557-292e-48bf-afa8-294ef2ce454f None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:00.741679 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a276666-dd6a-4dac-b4b1-41f06c7cfdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:00.742454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a276666-dd6a-4dac-b4b1-41f06c7cfdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:00.742740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a276666-dd6a-4dac-b4b1-41f06c7cfdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:00.743018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a276666-dd6a-4dac-b4b1-41f06c7cfdf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:00.753909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a276666-dd6a-4dac-b4b1-41f06c7cfdf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-2a276666-dd6a-4dac-b4b1-41f06c7cfdf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:56:00.761412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:00.762524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:56:00.763567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 574/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:56:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:00.769170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae40a7a-dd50-4430-aa03-8b5c78f27fed None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:00.868582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae40a7a-dd50-4430-aa03-8b5c78f27fed None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:00.905304 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785b43c-9988-4d36-b0cb-c295a0c175da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:00.905980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785b43c-9988-4d36-b0cb-c295a0c175da None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:00.906295 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785b43c-9988-4d36-b0cb-c295a0c175da None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:00.906579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785b43c-9988-4d36-b0cb-c295a0c175da None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:00.907327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785b43c-9988-4d36-b0cb-c295a0c175da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:00.907759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785b43c-9988-4d36-b0cb-c295a0c175da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:00.909342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785b43c-9988-4d36-b0cb-c295a0c175da None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:00.917324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 583/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:56:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:00.923121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a276666-dd6a-4dac-b4b1-41f06c7cfdf5 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:00.965951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:01.020215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a276666-dd6a-4dac-b4b1-41f06c7cfdf5 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:01.054041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf932-e27e-4de6-a34f-f97466152081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:01.058532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf932-e27e-4de6-a34f-f97466152081 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:01.058532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf932-e27e-4de6-a34f-f97466152081 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:01.058532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf932-e27e-4de6-a34f-f97466152081 None admin] PATH_INFO: `/v3/users/759ea23ff6364a9bbae4ee242bee061e` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:01.058532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbf932-e27e-4de6-a34f-f97466152081 None admin] RBAC: Authorizing `identity:get_user(user_id=759ea23ff6364a9bbae4ee242bee061e)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:01.058532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbf932-e27e-4de6-a34f-f97466152081 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:01.059732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 575/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:56:00 2022] GET /identity/v3/users/759ea23ff6364a9bbae4ee242bee061e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:01.066126 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785b43c-9988-4d36-b0cb-c295a0c175da None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:01.106278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:01.163234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785b43c-9988-4d36-b0cb-c295a0c175da None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:01.197199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e6833-1492-4e80-b68b-4ceb4e450e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:01.197832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6833-1492-4e80-b68b-4ceb4e450e58 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:01.198112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6833-1492-4e80-b68b-4ceb4e450e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:01.198385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6833-1492-4e80-b68b-4ceb4e450e58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:01.262304 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e6833-1492-4e80-b68b-4ceb4e450e58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:01.263762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e6833-1492-4e80-b68b-4ceb4e450e58 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:01.302290 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:01.357596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 584/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:56:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 09:56:01.364154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf932-e27e-4de6-a34f-f97466152081 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:01.462882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf932-e27e-4de6-a34f-f97466152081 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:01.474074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:01.496533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd584f9-ac2e-4048-9682-6bfc5eaf27da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:01.497383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd584f9-ac2e-4048-9682-6bfc5eaf27da None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:01.497668 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd584f9-ac2e-4048-9682-6bfc5eaf27da None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:01.498199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd584f9-ac2e-4048-9682-6bfc5eaf27da None admin] PATH_INFO: `/v3/projects/e050945db99f41a9b613c7d10c626fbe` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:01.499152 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd584f9-ac2e-4048-9682-6bfc5eaf27da None admin] RBAC: Authorizing `identity:get_project(project_id=e050945db99f41a9b613c7d10c626fbe)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:01.500603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd584f9-ac2e-4048-9682-6bfc5eaf27da None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:01.503344 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 576/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:56:01 2022] GET /identity/v3/projects/e050945db99f41a9b613c7d10c626fbe => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:01.509489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e6833-1492-4e80-b68b-4ceb4e450e58 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:01.604302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e6833-1492-4e80-b68b-4ceb4e450e58 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:01.636835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfaccd-9959-4623-86d8-be345b48e62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:01.637470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfaccd-9959-4623-86d8-be345b48e62a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:01.637753 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfaccd-9959-4623-86d8-be345b48e62a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:01.638024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfaccd-9959-4623-86d8-be345b48e62a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:01.638841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfaccd-9959-4623-86d8-be345b48e62a None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=e050945db99f41a9b613c7d10c626fbe, user.id=759ea23ff6364a9bbae4ee242bee061e) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:01.639156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfaccd-9959-4623-86d8-be345b48e62a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:01.640617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfaccd-9959-4623-86d8-be345b48e62a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:01.646465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 585/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:56:01 2022] GET /identity/v3/role_assignments?user.id=759ea23ff6364a9bbae4ee242bee061e&scope.project.id=e050945db99f41a9b613c7d10c626fbe&role.id=918b179f19b6437493eabe5394fa9af0 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:03.897028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d183cc-c1d2-42f3-83f2-6720541874e6 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:03.897539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d183cc-c1d2-42f3-83f2-6720541874e6 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:03.897633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d183cc-c1d2-42f3-83f2-6720541874e6 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:03.898961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 577/1162] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:03.904356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e318-2929-4261-be48-78b2a8902411 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:03.904737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e318-2929-4261-be48-78b2a8902411 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:03.904923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e318-2929-4261-be48-78b2a8902411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:03.911003 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:03.921493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3af2e318-2929-4261-be48-78b2a8902411 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:03.922676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3af2e318-2929-4261-be48-78b2a8902411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:03.988757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 586/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:04.011648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d183cc-c1d2-42f3-83f2-6720541874e6 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:04.112072 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d183cc-c1d2-42f3-83f2-6720541874e6 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:04.144384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10401af3-45d6-4cbc-9f02-2359ff37ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:04.144957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10401af3-45d6-4cbc-9f02-2359ff37ce69 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:04.145237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10401af3-45d6-4cbc-9f02-2359ff37ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:04.145508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10401af3-45d6-4cbc-9f02-2359ff37ce69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:04.189233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:04.209318 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10401af3-45d6-4cbc-9f02-2359ff37ce69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:04.210760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10401af3-45d6-4cbc-9f02-2359ff37ce69 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:04.304669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 578/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:56:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:56:04.310678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2e318-2929-4261-be48-78b2a8902411 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:04.405692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2e318-2929-4261-be48-78b2a8902411 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:04.438516 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd3640-ddb5-486f-8e25-e85f3fb66000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:04.439330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3640-ddb5-486f-8e25-e85f3fb66000 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:04.439633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3640-ddb5-486f-8e25-e85f3fb66000 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:04.439908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd3640-ddb5-486f-8e25-e85f3fb66000 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:04.441721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:04.446821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd3640-ddb5-486f-8e25-e85f3fb66000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:04.451713 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd3640-ddb5-486f-8e25-e85f3fb66000 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-3ffd3640-ddb5-486f-8e25-e85f3fb66000 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:04.462666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:04.463913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:56:04.465114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 587/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 2 09:56:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:04.469751 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10401af3-45d6-4cbc-9f02-2359ff37ce69 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:04.545576 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:04.567112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10401af3-45d6-4cbc-9f02-2359ff37ce69 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:04.601870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08894f-91a3-4321-91b8-efe1bab91c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:04.602524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08894f-91a3-4321-91b8-efe1bab91c20 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:04.602812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08894f-91a3-4321-91b8-efe1bab91c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:04.603094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08894f-91a3-4321-91b8-efe1bab91c20 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:04.603841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08894f-91a3-4321-91b8-efe1bab91c20 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:04.604156 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08894f-91a3-4321-91b8-efe1bab91c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:04.605526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08894f-91a3-4321-91b8-efe1bab91c20 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:04.613613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 579/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jun 2 09:56:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:56:06.848203 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2ba9-3320-4756-baa0-98bce78f4402 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:06.848729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2ba9-3320-4756-baa0-98bce78f4402 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:06.848822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b2ba9-3320-4756-baa0-98bce78f4402 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:06.850151 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 588/1167] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:06.855334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f13b5-a0eb-48a0-9054-d34844b2a88c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:06.855762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f13b5-a0eb-48a0-9054-d34844b2a88c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:06.855925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f13b5-a0eb-48a0-9054-d34844b2a88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:06.874177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a35f13b5-a0eb-48a0-9054-d34844b2a88c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:06.875365 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a35f13b5-a0eb-48a0-9054-d34844b2a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:06.940831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 580/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:06.964252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b2ba9-3320-4756-baa0-98bce78f4402 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:07.067601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b2ba9-3320-4756-baa0-98bce78f4402 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:07.101312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c31579-4dc2-4d43-9a46-7275959cc1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:07.101889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31579-4dc2-4d43-9a46-7275959cc1c7 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:07.102168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31579-4dc2-4d43-9a46-7275959cc1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:07.102447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31579-4dc2-4d43-9a46-7275959cc1c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:07.103200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c31579-4dc2-4d43-9a46-7275959cc1c7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:07.104605 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c31579-4dc2-4d43-9a46-7275959cc1c7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:07.191664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 589/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Thu Jun 2 09:56:06 2022] POST /identity/v3/domains => generated 267 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:56:09.437875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca1ef-af43-49e5-b6b1-c49b44181d00 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:09.438423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca1ef-af43-49e5-b6b1-c49b44181d00 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:09.438538 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca1ef-af43-49e5-b6b1-c49b44181d00 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:09.440206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 581/1170] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:09.445354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a9d5-b5d6-4f7b-9ad3-23d14db6195b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:09.445786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a9d5-b5d6-4f7b-9ad3-23d14db6195b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:09.445921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a9d5-b5d6-4f7b-9ad3-23d14db6195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:09.462846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-76e2a9d5-b5d6-4f7b-9ad3-23d14db6195b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:09.464066 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-76e2a9d5-b5d6-4f7b-9ad3-23d14db6195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:09.511796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:09.529234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 590/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:09.553111 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca1ef-af43-49e5-b6b1-c49b44181d00 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:09.623105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:09.653352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca1ef-af43-49e5-b6b1-c49b44181d00 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:09.686278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbbdda-ec1b-4caf-a8f7-fe7772ffae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:09.687132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbbdda-ec1b-4caf-a8f7-fe7772ffae14 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:09.687416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbbdda-ec1b-4caf-a8f7-fe7772ffae14 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:09.687727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbbdda-ec1b-4caf-a8f7-fe7772ffae14 None admin] PATH_INFO: `/v3/domains/ddea66bc52ae4b3789a428b7422ff5e3` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:09.698457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbbdda-ec1b-4caf-a8f7-fe7772ffae14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddea66bc52ae4b3789a428b7422ff5e3)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:09.699867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbbdda-ec1b-4caf-a8f7-fe7772ffae14 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:09.701486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 582/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Jun 2 09:56:09 2022] GET /identity/v3/domains/ddea66bc52ae4b3789a428b7422ff5e3 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:09.707990 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a9d5-b5d6-4f7b-9ad3-23d14db6195b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:09.803867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a9d5-b5d6-4f7b-9ad3-23d14db6195b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:09.838221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb490c5c-a54d-4170-91bc-805917e7feed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:09.838870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490c5c-a54d-4170-91bc-805917e7feed None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:09.839157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490c5c-a54d-4170-91bc-805917e7feed None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:09.839433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb490c5c-a54d-4170-91bc-805917e7feed None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:09.840184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb490c5c-a54d-4170-91bc-805917e7feed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:09.841615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb490c5c-a54d-4170-91bc-805917e7feed None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:09.945577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 591/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:56:09 2022] POST /identity/v3/projects => generated 361 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 09:56:12.197755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bad5e-996f-44c1-a255-f3ed45155c51 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:12.198251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bad5e-996f-44c1-a255-f3ed45155c51 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:12.198251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bad5e-996f-44c1-a255-f3ed45155c51 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:12.199712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 583/1174] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:12.205562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a1ac-12c5-445a-a6d0-fda05ecd60c7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:12.205978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a1ac-12c5-445a-a6d0-fda05ecd60c7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:12.206116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61a1ac-12c5-445a-a6d0-fda05ecd60c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:12.222417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ee61a1ac-12c5-445a-a6d0-fda05ecd60c7 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:12.223587 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ee61a1ac-12c5-445a-a6d0-fda05ecd60c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:12.251466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:12.288839 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 592/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:12.316524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bad5e-996f-44c1-a255-f3ed45155c51 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:12.414314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bad5e-996f-44c1-a255-f3ed45155c51 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:12.442400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:12.446872 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb6be3-e5de-40e0-8edf-4807b09ef2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:12.447752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb6be3-e5de-40e0-8edf-4807b09ef2da None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:12.448081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb6be3-e5de-40e0-8edf-4807b09ef2da None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:12.448308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb6be3-e5de-40e0-8edf-4807b09ef2da None admin] PATH_INFO: `/v3/domains/ddea66bc52ae4b3789a428b7422ff5e3` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:12.449454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb6be3-e5de-40e0-8edf-4807b09ef2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=ddea66bc52ae4b3789a428b7422ff5e3)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:12.450873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb6be3-e5de-40e0-8edf-4807b09ef2da None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:12.452491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 584/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Jun 2 09:56:12 2022] GET /identity/v3/domains/ddea66bc52ae4b3789a428b7422ff5e3 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:12.458317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61a1ac-12c5-445a-a6d0-fda05ecd60c7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:12.556191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61a1ac-12c5-445a-a6d0-fda05ecd60c7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:12.589422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d712ffc-e501-4132-b65e-48ddd8d3e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:12.590082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d712ffc-e501-4132-b65e-48ddd8d3e0a3 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:12.590368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d712ffc-e501-4132-b65e-48ddd8d3e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:12.590648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d712ffc-e501-4132-b65e-48ddd8d3e0a3 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:12.591369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d712ffc-e501-4132-b65e-48ddd8d3e0a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:12.592836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d712ffc-e501-4132-b65e-48ddd8d3e0a3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:12.671040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 593/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:56:12 2022] POST /identity/v3/users => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:56:14.935096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e781ad-b5cc-42a7-b6b7-099d0762e399 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:14.935664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e781ad-b5cc-42a7-b6b7-099d0762e399 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:14.935664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e781ad-b5cc-42a7-b6b7-099d0762e399 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:14.937060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 585/1178] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:14.942900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab7d0-2ad7-427b-95ff-3bef9ab8276f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:14.943310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab7d0-2ad7-427b-95ff-3bef9ab8276f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:14.943448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab7d0-2ad7-427b-95ff-3bef9ab8276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:14.960205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fc0ab7d0-2ad7-427b-95ff-3bef9ab8276f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:14.961363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fc0ab7d0-2ad7-427b-95ff-3bef9ab8276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:14.977020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:15.025741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 594/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:15.050454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e781ad-b5cc-42a7-b6b7-099d0762e399 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:15.152061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e781ad-b5cc-42a7-b6b7-099d0762e399 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:15.185434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2380be7-8022-4f6d-9386-f3dcd35416c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:15.186215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2380be7-8022-4f6d-9386-f3dcd35416c8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:15.186503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2380be7-8022-4f6d-9386-f3dcd35416c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:15.186883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2380be7-8022-4f6d-9386-f3dcd35416c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:15.198108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2380be7-8022-4f6d-9386-f3dcd35416c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-a2380be7-8022-4f6d-9386-f3dcd35416c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:56:15.206297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:15.207406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:56:15.208482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 586/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:56:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:15.213517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ab7d0-2ad7-427b-95ff-3bef9ab8276f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:15.311017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ab7d0-2ad7-427b-95ff-3bef9ab8276f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:15.346215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482ed2d-db1e-42ce-9286-93f8182ae832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:15.346879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ed2d-db1e-42ce-9286-93f8182ae832 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:15.347167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ed2d-db1e-42ce-9286-93f8182ae832 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:15.347446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482ed2d-db1e-42ce-9286-93f8182ae832 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:15.348223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482ed2d-db1e-42ce-9286-93f8182ae832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:15.348536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482ed2d-db1e-42ce-9286-93f8182ae832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:15.349904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d482ed2d-db1e-42ce-9286-93f8182ae832 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:15.357732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 595/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:56:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:15.363356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2380be7-8022-4f6d-9386-f3dcd35416c8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:15.422293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:15.461977 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2380be7-8022-4f6d-9386-f3dcd35416c8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:15.495787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8895c5-73c9-414f-a25c-72d5cacc51d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:15.496657 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8895c5-73c9-414f-a25c-72d5cacc51d9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:15.496942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8895c5-73c9-414f-a25c-72d5cacc51d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:15.497220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8895c5-73c9-414f-a25c-72d5cacc51d9 None admin] PATH_INFO: `/v3/users/e21ae60ce49b435da3bef734d91ad13e` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:15.510301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8895c5-73c9-414f-a25c-72d5cacc51d9 None admin] RBAC: Authorizing `identity:get_user(user_id=e21ae60ce49b435da3bef734d91ad13e)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:15.511777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8895c5-73c9-414f-a25c-72d5cacc51d9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:15.513406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 587/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:56:15 2022] GET /identity/v3/users/e21ae60ce49b435da3bef734d91ad13e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:15.519602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482ed2d-db1e-42ce-9286-93f8182ae832 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:15.536172 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:15.617928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d482ed2d-db1e-42ce-9286-93f8182ae832 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:15.651020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22920b5-c36b-47e5-b438-b04c83c7b42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:15.651677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22920b5-c36b-47e5-b438-b04c83c7b42b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:15.651967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22920b5-c36b-47e5-b438-b04c83c7b42b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:15.652247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22920b5-c36b-47e5-b438-b04c83c7b42b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:15.716978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22920b5-c36b-47e5-b438-b04c83c7b42b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:15.718363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22920b5-c36b-47e5-b438-b04c83c7b42b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:15.733340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:15.814272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 596/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:56:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:56:15.819983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8895c5-73c9-414f-a25c-72d5cacc51d9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:15.917494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8895c5-73c9-414f-a25c-72d5cacc51d9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:15.934213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:15.950970 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd56a3f-658c-4c2c-8426-cf78c598c9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:15.966791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd56a3f-658c-4c2c-8426-cf78c598c9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:15.966791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd56a3f-658c-4c2c-8426-cf78c598c9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:15.966791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd56a3f-658c-4c2c-8426-cf78c598c9f3 None admin] PATH_INFO: `/v3/projects/bd85ece592f542698fadca1dedd12b36` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:15.966791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd56a3f-658c-4c2c-8426-cf78c598c9f3 None admin] RBAC: Authorizing `identity:get_project(project_id=bd85ece592f542698fadca1dedd12b36)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:15.966791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd56a3f-658c-4c2c-8426-cf78c598c9f3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:15.966791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 588/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:56:15 2022] GET /identity/v3/projects/bd85ece592f542698fadca1dedd12b36 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:15.967281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22920b5-c36b-47e5-b438-b04c83c7b42b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:16.059625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22920b5-c36b-47e5-b438-b04c83c7b42b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:16.073620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:16.092633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954693a7-d2ac-4a2c-8b19-74e780913889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:16.093275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954693a7-d2ac-4a2c-8b19-74e780913889 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:16.093555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954693a7-d2ac-4a2c-8b19-74e780913889 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:16.093828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954693a7-d2ac-4a2c-8b19-74e780913889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:16.094694 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954693a7-d2ac-4a2c-8b19-74e780913889 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=bd85ece592f542698fadca1dedd12b36, user.id=e21ae60ce49b435da3bef734d91ad13e) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:16.095006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954693a7-d2ac-4a2c-8b19-74e780913889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:16.096530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954693a7-d2ac-4a2c-8b19-74e780913889 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:16.102350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 597/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:56:15 2022] GET /identity/v3/role_assignments?user.id=e21ae60ce49b435da3bef734d91ad13e&scope.project.id=bd85ece592f542698fadca1dedd12b36&role.id=918b179f19b6437493eabe5394fa9af0 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:18.311807 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0241a-f95c-4de9-9654-cd7dee5cc44c None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:18.312351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0241a-f95c-4de9-9654-cd7dee5cc44c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:18.312351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0241a-f95c-4de9-9654-cd7dee5cc44c None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:18.314314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 589/1186] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:18.319568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa87b1-3e80-4c0e-a6cc-4f3fd1a94e14 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:18.319960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa87b1-3e80-4c0e-a6cc-4f3fd1a94e14 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:18.320166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa87b1-3e80-4c0e-a6cc-4f3fd1a94e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:18.337175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-50aa87b1-3e80-4c0e-a6cc-4f3fd1a94e14 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:18.338354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-50aa87b1-3e80-4c0e-a6cc-4f3fd1a94e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:18.402807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 598/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:18.426152 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0241a-f95c-4de9-9654-cd7dee5cc44c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:18.523587 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0241a-f95c-4de9-9654-cd7dee5cc44c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:18.555960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f11c8f-a195-44d5-9329-dc6148c73f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:18.556722 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f11c8f-a195-44d5-9329-dc6148c73f49 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:18.557000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f11c8f-a195-44d5-9329-dc6148c73f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:18.557270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f11c8f-a195-44d5-9329-dc6148c73f49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:18.567496 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f11c8f-a195-44d5-9329-dc6148c73f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-29f11c8f-a195-44d5-9329-dc6148c73f49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:56:18.575027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:18.576241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:56:18.577493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 590/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:56:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:18.582712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa87b1-3e80-4c0e-a6cc-4f3fd1a94e14 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:18.678927 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa87b1-3e80-4c0e-a6cc-4f3fd1a94e14 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:18.687814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:18.710945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744ad64-f129-4bc8-9812-58bd13e20f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:18.711631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ad64-f129-4bc8-9812-58bd13e20f12 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:18.711920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ad64-f129-4bc8-9812-58bd13e20f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:18.712200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744ad64-f129-4bc8-9812-58bd13e20f12 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:18.712944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744ad64-f129-4bc8-9812-58bd13e20f12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:18.713280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744ad64-f129-4bc8-9812-58bd13e20f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:18.714650 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744ad64-f129-4bc8-9812-58bd13e20f12 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:18.723141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 599/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:56:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:18.729008 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f11c8f-a195-44d5-9329-dc6148c73f49 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:18.773998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:18.824879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f11c8f-a195-44d5-9329-dc6148c73f49 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:18.856683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111670-c975-4bb9-822d-75c5d0b37d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:18.857537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111670-c975-4bb9-822d-75c5d0b37d4a None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:18.857817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111670-c975-4bb9-822d-75c5d0b37d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:18.858091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111670-c975-4bb9-822d-75c5d0b37d4a None admin] PATH_INFO: `/v3/users/e21ae60ce49b435da3bef734d91ad13e` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:18.859243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a111670-c975-4bb9-822d-75c5d0b37d4a None admin] RBAC: Authorizing `identity:get_user(user_id=e21ae60ce49b435da3bef734d91ad13e)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:18.861012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a111670-c975-4bb9-822d-75c5d0b37d4a None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:18.862637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 591/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:56:18 2022] GET /identity/v3/users/e21ae60ce49b435da3bef734d91ad13e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:18.868265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744ad64-f129-4bc8-9812-58bd13e20f12 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:18.965621 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744ad64-f129-4bc8-9812-58bd13e20f12 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:18.997254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7709b5-e603-4488-9415-b29cd9cb6f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:18.998109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7709b5-e603-4488-9415-b29cd9cb6f08 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:18.998394 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7709b5-e603-4488-9415-b29cd9cb6f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:18.998671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7709b5-e603-4488-9415-b29cd9cb6f08 None admin] PATH_INFO: `/v3/projects/bd85ece592f542698fadca1dedd12b36` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:18.999864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7709b5-e603-4488-9415-b29cd9cb6f08 None admin] RBAC: Authorizing `identity:get_project(project_id=bd85ece592f542698fadca1dedd12b36)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:19.001833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7709b5-e603-4488-9415-b29cd9cb6f08 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:19.003507 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 600/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:56:18 2022] GET /identity/v3/projects/bd85ece592f542698fadca1dedd12b36 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:19.009358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111670-c975-4bb9-822d-75c5d0b37d4a None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:19.106657 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111670-c975-4bb9-822d-75c5d0b37d4a None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:19.120606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:19.141331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0451f49-494d-43ab-ba52-48a275640729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:19.142213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0451f49-494d-43ab-ba52-48a275640729 None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:19.142502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0451f49-494d-43ab-ba52-48a275640729 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:19.142779 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0451f49-494d-43ab-ba52-48a275640729 None admin] PATH_INFO: `/v3/projects/bd85ece592f542698fadca1dedd12b36/users/e21ae60ce49b435da3bef734d91ad13e/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:19.144862 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0451f49-494d-43ab-ba52-48a275640729 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd85ece592f542698fadca1dedd12b36, user_id=e21ae60ce49b435da3bef734d91ad13e, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:19.146278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0451f49-494d-43ab-ba52-48a275640729 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:19.213405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 592/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:56:19 2022] PUT /identity/v3/projects/bd85ece592f542698fadca1dedd12b36/users/e21ae60ce49b435da3bef734d91ad13e/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:56:21.474160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab54b9-98e2-41e6-a62e-715ee0d9de11 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:21.474692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab54b9-98e2-41e6-a62e-715ee0d9de11 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:21.474810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab54b9-98e2-41e6-a62e-715ee0d9de11 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:21.476131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 601/1193] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:56:21.481692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1948-c5be-4984-8926-603fb50e2c35 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:21.482061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1948-c5be-4984-8926-603fb50e2c35 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:21.482260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1948-c5be-4984-8926-603fb50e2c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:21.499151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-075a1948-c5be-4984-8926-603fb50e2c35 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:56:21.501173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-075a1948-c5be-4984-8926-603fb50e2c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:56:21.565876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 593/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:56:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:56:21.589777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab54b9-98e2-41e6-a62e-715ee0d9de11 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:21.630858 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:21.692214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab54b9-98e2-41e6-a62e-715ee0d9de11 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:21.725308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e8edb-d402-44bf-9e46-0ec5778df8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:21.726021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e8edb-d402-44bf-9e46-0ec5778df8bb None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:21.726307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e8edb-d402-44bf-9e46-0ec5778df8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:21.726584 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e8edb-d402-44bf-9e46-0ec5778df8bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:21.738276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e8edb-d402-44bf-9e46-0ec5778df8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-f28e8edb-d402-44bf-9e46-0ec5778df8bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:56:21.745891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:56:21.746993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:56:21.748091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 602/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:56:21.753992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a1948-c5be-4984-8926-603fb50e2c35 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:21.849882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a1948-c5be-4984-8926-603fb50e2c35 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:21.852154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:21.883752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0d9f6-b35c-452d-90d6-d093c95a5919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:21.884421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0d9f6-b35c-452d-90d6-d093c95a5919 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:21.884704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0d9f6-b35c-452d-90d6-d093c95a5919 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:21.884978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0d9f6-b35c-452d-90d6-d093c95a5919 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:21.885722 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0d9f6-b35c-452d-90d6-d093c95a5919 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:21.886032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0d9f6-b35c-452d-90d6-d093c95a5919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:21.887397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0d9f6-b35c-452d-90d6-d093c95a5919 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:21.895500 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 594/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:56:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:21.901545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e8edb-d402-44bf-9e46-0ec5778df8bb None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:21.997539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:22.001497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e8edb-d402-44bf-9e46-0ec5778df8bb None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:22.036504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fce6c9-24a6-4027-9e62-0020b3d75e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:22.037364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fce6c9-24a6-4027-9e62-0020b3d75e4e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:22.037653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fce6c9-24a6-4027-9e62-0020b3d75e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:22.037932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fce6c9-24a6-4027-9e62-0020b3d75e4e None admin] PATH_INFO: `/v3/users/e21ae60ce49b435da3bef734d91ad13e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:22.039107 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fce6c9-24a6-4027-9e62-0020b3d75e4e None admin] RBAC: Authorizing `identity:get_user(user_id=e21ae60ce49b435da3bef734d91ad13e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:22.040577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fce6c9-24a6-4027-9e62-0020b3d75e4e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:22.042193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 603/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jun 2 09:56:21 2022] GET /identity/v3/users/e21ae60ce49b435da3bef734d91ad13e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:22.047959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0d9f6-b35c-452d-90d6-d093c95a5919 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:22.145019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0d9f6-b35c-452d-90d6-d093c95a5919 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:22.177959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a7ad5-007e-42f1-b5ee-3308b92611cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:22.178602 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a7ad5-007e-42f1-b5ee-3308b92611cf None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:22.178893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a7ad5-007e-42f1-b5ee-3308b92611cf None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:22.179177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a7ad5-007e-42f1-b5ee-3308b92611cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:22.212218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:22.245871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a7ad5-007e-42f1-b5ee-3308b92611cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:22.247336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a7ad5-007e-42f1-b5ee-3308b92611cf None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:22.343232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 595/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:56:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:56:22.349156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fce6c9-24a6-4027-9e62-0020b3d75e4e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:22.445884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fce6c9-24a6-4027-9e62-0020b3d75e4e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:22.478518 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c5994-1476-4d4c-9ea2-fe24c7a23992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:22.479366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5994-1476-4d4c-9ea2-fe24c7a23992 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:22.479680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5994-1476-4d4c-9ea2-fe24c7a23992 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:22.479963 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c5994-1476-4d4c-9ea2-fe24c7a23992 None admin] PATH_INFO: `/v3/projects/bd85ece592f542698fadca1dedd12b36` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:22.481141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5994-1476-4d4c-9ea2-fe24c7a23992 None admin] RBAC: Authorizing `identity:get_project(project_id=bd85ece592f542698fadca1dedd12b36)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:22.482575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c5994-1476-4d4c-9ea2-fe24c7a23992 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:22.484852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 604/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jun 2 09:56:22 2022] GET /identity/v3/projects/bd85ece592f542698fadca1dedd12b36 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:22.490942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a7ad5-007e-42f1-b5ee-3308b92611cf None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:56:22.552787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:22.584839 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a7ad5-007e-42f1-b5ee-3308b92611cf None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:56:22.618248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396c4b3-3f55-4eb8-ac66-3e7f083cef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:56:22.618818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396c4b3-3f55-4eb8-ac66-3e7f083cef86 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:56:22.619098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396c4b3-3f55-4eb8-ac66-3e7f083cef86 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:56:22.619371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396c4b3-3f55-4eb8-ac66-3e7f083cef86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:56:22.620219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396c4b3-3f55-4eb8-ac66-3e7f083cef86 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=bd85ece592f542698fadca1dedd12b36, user.id=e21ae60ce49b435da3bef734d91ad13e) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:56:22.620530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396c4b3-3f55-4eb8-ac66-3e7f083cef86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:56:22.621939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396c4b3-3f55-4eb8-ac66-3e7f083cef86 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:56:22.627741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 596/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:56:22 2022] GET /identity/v3/role_assignments?user.id=e21ae60ce49b435da3bef734d91ad13e&scope.project.id=bd85ece592f542698fadca1dedd12b36&role.id=918b179f19b6437493eabe5394fa9af0 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:56:32.474523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=83 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:56:32.625191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=35 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:39.982257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a0ad-118a-4daa-9e31-2ac33d077b94 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:39.982875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a0ad-118a-4daa-9e31-2ac33d077b94 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:39.982875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a0ad-118a-4daa-9e31-2ac33d077b94 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:39.984195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 605/1201] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:57:39.989498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a181ff1-794a-46ba-b712-0ab162bde3b8 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:39.989926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a181ff1-794a-46ba-b712-0ab162bde3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:39.990154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a181ff1-794a-46ba-b712-0ab162bde3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:40.007245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-6a181ff1-794a-46ba-b712-0ab162bde3b8 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:57:40.008458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6a181ff1-794a-46ba-b712-0ab162bde3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:57:40.075745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 597/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:57:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:57:40.100694 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a0ad-118a-4daa-9e31-2ac33d077b94 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:40.203342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a0ad-118a-4daa-9e31-2ac33d077b94 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:40.236979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52452f-6c16-43ce-baaf-e6f266ee6728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:40.237762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52452f-6c16-43ce-baaf-e6f266ee6728 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:40.239452 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52452f-6c16-43ce-baaf-e6f266ee6728 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:40.239452 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52452f-6c16-43ce-baaf-e6f266ee6728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:40.249110 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52452f-6c16-43ce-baaf-e6f266ee6728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:40.250552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52452f-6c16-43ce-baaf-e6f266ee6728 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-ca52452f-6c16-43ce-baaf-e6f266ee6728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:40.268581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:40.269749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:40.271050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:40.271050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:40.271050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:40.271050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:57:40.271050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 606/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:40.276246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a181ff1-794a-46ba-b712-0ab162bde3b8 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:40.371876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a181ff1-794a-46ba-b712-0ab162bde3b8 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:40.399735 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:40.406240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a369df2-b490-4c4c-b8de-82a1f4180748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:40.406904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a369df2-b490-4c4c-b8de-82a1f4180748 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:40.407189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a369df2-b490-4c4c-b8de-82a1f4180748 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:40.407466 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a369df2-b490-4c4c-b8de-82a1f4180748 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:40.408218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a369df2-b490-4c4c-b8de-82a1f4180748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:40.408528 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a369df2-b490-4c4c-b8de-82a1f4180748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:40.409890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a369df2-b490-4c4c-b8de-82a1f4180748 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:40.421698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 598/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:40.427464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52452f-6c16-43ce-baaf-e6f266ee6728 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:40.482224 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:40.528495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52452f-6c16-43ce-baaf-e6f266ee6728 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:40.562247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57787bc1-bf8e-4049-8c98-2e34c5646aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:40.562899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57787bc1-bf8e-4049-8c98-2e34c5646aa8 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:40.563178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57787bc1-bf8e-4049-8c98-2e34c5646aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:40.563448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57787bc1-bf8e-4049-8c98-2e34c5646aa8 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:40.564179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57787bc1-bf8e-4049-8c98-2e34c5646aa8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:40.565640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57787bc1-bf8e-4049-8c98-2e34c5646aa8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:40.656189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 607/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jun 2 09:57:40 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:57:42.935160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4caffd-6c72-4ee2-8f4e-324edc10fbdc None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:42.935750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4caffd-6c72-4ee2-8f4e-324edc10fbdc None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:42.935750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4caffd-6c72-4ee2-8f4e-324edc10fbdc None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:42.937388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 599/1206] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:57:42.942572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb5b4-dcdd-444e-bd91-0e01a747db14 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:42.943000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb5b4-dcdd-444e-bd91-0e01a747db14 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:42.943174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb5b4-dcdd-444e-bd91-0e01a747db14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:42.960482 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2a0cb5b4-dcdd-444e-bd91-0e01a747db14 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:57:42.961714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2a0cb5b4-dcdd-444e-bd91-0e01a747db14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:57:43.027109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 608/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:57:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:57:43.051314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4caffd-6c72-4ee2-8f4e-324edc10fbdc None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:43.154222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4caffd-6c72-4ee2-8f4e-324edc10fbdc None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:43.188595 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1261e-9bec-4915-ab66-da0ec4b30ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:43.189389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1261e-9bec-4915-ab66-da0ec4b30ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:43.189674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1261e-9bec-4915-ab66-da0ec4b30ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:43.189952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1261e-9bec-4915-ab66-da0ec4b30ba1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:43.200557 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1261e-9bec-4915-ab66-da0ec4b30ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-b3c1261e-9bec-4915-ab66-da0ec4b30ba1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:57:43.208402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:43.214593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:43.215748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 600/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:57:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:43.216686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb5b4-dcdd-444e-bd91-0e01a747db14 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:43.256206 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:43.313377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb5b4-dcdd-444e-bd91-0e01a747db14 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:43.344885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e509be-9c33-428e-b2f2-83b826891933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:43.345534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e509be-9c33-428e-b2f2-83b826891933 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:43.345813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e509be-9c33-428e-b2f2-83b826891933 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:43.346087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e509be-9c33-428e-b2f2-83b826891933 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:43.346821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e509be-9c33-428e-b2f2-83b826891933 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:43.347125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e509be-9c33-428e-b2f2-83b826891933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:43.348644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e509be-9c33-428e-b2f2-83b826891933 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:43.356815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 609/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:43.362578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1261e-9bec-4915-ab66-da0ec4b30ba1 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:43.414252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:43.462807 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1261e-9bec-4915-ab66-da0ec4b30ba1 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:43.496778 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1f58e-c57f-4198-ba91-3d78e1ca88a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:43.497565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1f58e-c57f-4198-ba91-3d78e1ca88a5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:43.497848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1f58e-c57f-4198-ba91-3d78e1ca88a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:43.498121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1f58e-c57f-4198-ba91-3d78e1ca88a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:43.507813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1f58e-c57f-4198-ba91-3d78e1ca88a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:43.509402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1f58e-c57f-4198-ba91-3d78e1ca88a5 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-33b1f58e-c57f-4198-ba91-3d78e1ca88a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:43.528802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:43.529973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:43.531114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:43.531114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:43.531114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:43.531114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:43.531114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 601/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:43.536106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e509be-9c33-428e-b2f2-83b826891933 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:43.635644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:43.638546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e509be-9c33-428e-b2f2-83b826891933 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:43.673042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bcfd2-3538-4c4a-8cec-4e6762aeed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:43.673657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bcfd2-3538-4c4a-8cec-4e6762aeed25 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:43.673944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bcfd2-3538-4c4a-8cec-4e6762aeed25 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:43.674219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bcfd2-3538-4c4a-8cec-4e6762aeed25 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:43.674943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bcfd2-3538-4c4a-8cec-4e6762aeed25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:43.675250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bcfd2-3538-4c4a-8cec-4e6762aeed25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:43.676643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bcfd2-3538-4c4a-8cec-4e6762aeed25 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:43.688758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 610/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:43.694411 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1f58e-c57f-4198-ba91-3d78e1ca88a5 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:43.794912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1f58e-c57f-4198-ba91-3d78e1ca88a5 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:43.796651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:43.829332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd37d7c-d280-46d9-b53d-885710c82468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:43.830139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37d7c-d280-46d9-b53d-885710c82468 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:43.830427 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37d7c-d280-46d9-b53d-885710c82468 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:43.830708 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd37d7c-d280-46d9-b53d-885710c82468 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:43.837805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd37d7c-d280-46d9-b53d-885710c82468 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:43.839303 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd37d7c-d280-46d9-b53d-885710c82468 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-cbd37d7c-d280-46d9-b53d-885710c82468 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:57:43.856608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:43.857791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:43.858974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:43.858974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:43.858974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:57:43.858974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:57:43.858974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:57:43.858974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:57:43.858974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:57:43.858974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:57:43.858974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:43.858974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:43.858974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 602/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:43.864097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bcfd2-3538-4c4a-8cec-4e6762aeed25 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:43.963660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bcfd2-3538-4c4a-8cec-4e6762aeed25 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:43.998489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d43cc-b59b-4df5-827d-50703b803096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:43.999156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d43cc-b59b-4df5-827d-50703b803096 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:43.999435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d43cc-b59b-4df5-827d-50703b803096 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:43.999742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d43cc-b59b-4df5-827d-50703b803096 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:44.000576 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d43cc-b59b-4df5-827d-50703b803096 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:44.000887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d43cc-b59b-4df5-827d-50703b803096 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:44.002325 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d43cc-b59b-4df5-827d-50703b803096 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:44.020530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 611/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 2 09:57:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:44.026684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd37d7c-d280-46d9-b53d-885710c82468 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:44.126253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd37d7c-d280-46d9-b53d-885710c82468 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:44.160446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53eff8-4b96-4549-95d6-ea911adf290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:44.161084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53eff8-4b96-4549-95d6-ea911adf290e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:44.161366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53eff8-4b96-4549-95d6-ea911adf290e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:44.161642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53eff8-4b96-4549-95d6-ea911adf290e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:44.192267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:44.230826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53eff8-4b96-4549-95d6-ea911adf290e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:44.232270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53eff8-4b96-4549-95d6-ea911adf290e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:44.327029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 603/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:57:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:57:44.332867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d43cc-b59b-4df5-827d-50703b803096 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:44.352074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:44.434419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d43cc-b59b-4df5-827d-50703b803096 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:44.468142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91b479-e1f2-49f0-95d5-5c96e7d10168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:44.468933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b479-e1f2-49f0-95d5-5c96e7d10168 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:44.469219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b479-e1f2-49f0-95d5-5c96e7d10168 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:44.469497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91b479-e1f2-49f0-95d5-5c96e7d10168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:44.480500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91b479-e1f2-49f0-95d5-5c96e7d10168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:44.482009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91b479-e1f2-49f0-95d5-5c96e7d10168 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2c91b479-e1f2-49f0-95d5-5c96e7d10168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:44.499743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:44.500794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:44.501932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:44.501932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:44.501932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:44.501932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:57:44.501932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 612/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:44.506642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53eff8-4b96-4549-95d6-ea911adf290e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:44.567480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:44.603446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53eff8-4b96-4549-95d6-ea911adf290e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:44.637893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b4567-e613-4e0e-98ad-ba0e317d27ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:44.638537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b4567-e613-4e0e-98ad-ba0e317d27ec None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:44.638818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b4567-e613-4e0e-98ad-ba0e317d27ec None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:44.639088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b4567-e613-4e0e-98ad-ba0e317d27ec None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:44.639826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b4567-e613-4e0e-98ad-ba0e317d27ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:44.640130 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b4567-e613-4e0e-98ad-ba0e317d27ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:44.641510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b4567-e613-4e0e-98ad-ba0e317d27ec None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:44.653071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 604/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:44.658641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91b479-e1f2-49f0-95d5-5c96e7d10168 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:44.725740 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:44.755973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91b479-e1f2-49f0-95d5-5c96e7d10168 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:44.790000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df2884-4ef0-4627-95ac-9024d106f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:44.790779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df2884-4ef0-4627-95ac-9024d106f53d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:44.791053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df2884-4ef0-4627-95ac-9024d106f53d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:44.791982 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df2884-4ef0-4627-95ac-9024d106f53d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:44.798451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df2884-4ef0-4627-95ac-9024d106f53d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:44.799970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df2884-4ef0-4627-95ac-9024d106f53d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-25df2884-4ef0-4627-95ac-9024d106f53d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:57:44.814086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:44.815189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:44.816406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:57:44.816406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:57:44.816406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:57:44.816406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:57:44.816406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:57:44.816406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:57:44.816406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:44.816406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:57:44.819796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 613/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:44.824904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b4567-e613-4e0e-98ad-ba0e317d27ec None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:44.921486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b4567-e613-4e0e-98ad-ba0e317d27ec None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:44.943369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:44.954760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f94bda-9e8d-4cc1-beb9-68f54228f709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:44.955421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f94bda-9e8d-4cc1-beb9-68f54228f709 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:44.955738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f94bda-9e8d-4cc1-beb9-68f54228f709 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:44.956019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f94bda-9e8d-4cc1-beb9-68f54228f709 None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:44.956852 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f94bda-9e8d-4cc1-beb9-68f54228f709 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:44.957168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f94bda-9e8d-4cc1-beb9-68f54228f709 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:44.958640 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f94bda-9e8d-4cc1-beb9-68f54228f709 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:44.971456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 605/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:44.977636 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df2884-4ef0-4627-95ac-9024d106f53d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:45.078358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df2884-4ef0-4627-95ac-9024d106f53d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:45.106555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:45.112314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52120f4f-9a59-4b6b-ae64-402db273dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:45.112950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52120f4f-9a59-4b6b-ae64-402db273dbcc None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:45.113230 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52120f4f-9a59-4b6b-ae64-402db273dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:45.113499 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52120f4f-9a59-4b6b-ae64-402db273dbcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:45.114315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52120f4f-9a59-4b6b-ae64-402db273dbcc None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=fbdf5c7049f8499b8a25c88fbf4cb795) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:45.114623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52120f4f-9a59-4b6b-ae64-402db273dbcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:45.116099 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52120f4f-9a59-4b6b-ae64-402db273dbcc None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:45.121700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 614/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:57:44 2022] GET /identity/v3/role_assignments?user.id=fbdf5c7049f8499b8a25c88fbf4cb795&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:47.339183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec628bf-4504-4d11-bb94-7aa89664ebd4 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:47.339768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec628bf-4504-4d11-bb94-7aa89664ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:47.339768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec628bf-4504-4d11-bb94-7aa89664ebd4 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:47.341147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 606/1220] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:57:47.346291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41322af-da5d-4b80-aca3-b8c99b100cb4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:47.346730 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41322af-da5d-4b80-aca3-b8c99b100cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:47.346862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41322af-da5d-4b80-aca3-b8c99b100cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:47.364652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e41322af-da5d-4b80-aca3-b8c99b100cb4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:57:47.365851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e41322af-da5d-4b80-aca3-b8c99b100cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:57:47.436117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 615/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:57:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:57:47.459530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec628bf-4504-4d11-bb94-7aa89664ebd4 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:47.565191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec628bf-4504-4d11-bb94-7aa89664ebd4 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:47.600974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559ee2f-f2d0-4eac-b333-1a2428b7f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:47.601750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559ee2f-f2d0-4eac-b333-1a2428b7f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:47.602037 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559ee2f-f2d0-4eac-b333-1a2428b7f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:47.602315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559ee2f-f2d0-4eac-b333-1a2428b7f4e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:47.612895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559ee2f-f2d0-4eac-b333-1a2428b7f4e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-d559ee2f-f2d0-4eac-b333-1a2428b7f4e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:57:47.620709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:47.624776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:47.625815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 607/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:57:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:47.627987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41322af-da5d-4b80-aca3-b8c99b100cb4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:47.727537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41322af-da5d-4b80-aca3-b8c99b100cb4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:47.750825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:47.761909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d3896-1890-4635-83e3-5c0ca3ad90c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:47.762581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d3896-1890-4635-83e3-5c0ca3ad90c0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:47.762868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d3896-1890-4635-83e3-5c0ca3ad90c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:47.763146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d3896-1890-4635-83e3-5c0ca3ad90c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:47.763928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d3896-1890-4635-83e3-5c0ca3ad90c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:47.764242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d3896-1890-4635-83e3-5c0ca3ad90c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:47.765612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d3896-1890-4635-83e3-5c0ca3ad90c0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:47.773739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 616/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:57:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:47.780418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559ee2f-f2d0-4eac-b333-1a2428b7f4e4 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:47.823082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:47.880014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559ee2f-f2d0-4eac-b333-1a2428b7f4e4 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:47.915970 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd240350-e61b-4ebb-9269-b743e4ce215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:47.916771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd240350-e61b-4ebb-9269-b743e4ce215f None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:47.917061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd240350-e61b-4ebb-9269-b743e4ce215f None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:47.917343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd240350-e61b-4ebb-9269-b743e4ce215f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:47.927765 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd240350-e61b-4ebb-9269-b743e4ce215f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:47.929203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd240350-e61b-4ebb-9269-b743e4ce215f None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-bd240350-e61b-4ebb-9269-b743e4ce215f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:47.946351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:47.948054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:47.949607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:47.949607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:47.949607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:47.949607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:47.949607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 608/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:47.954155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d3896-1890-4635-83e3-5c0ca3ad90c0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:48.054725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d3896-1890-4635-83e3-5c0ca3ad90c0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:48.088666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cea91c-4054-4750-b67f-6e24297b0303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:48.089335 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea91c-4054-4750-b67f-6e24297b0303 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:48.089619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea91c-4054-4750-b67f-6e24297b0303 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:48.089901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea91c-4054-4750-b67f-6e24297b0303 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:48.090608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cea91c-4054-4750-b67f-6e24297b0303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:48.090914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cea91c-4054-4750-b67f-6e24297b0303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:48.092310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cea91c-4054-4750-b67f-6e24297b0303 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:48.104369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 617/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:57:48.110064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd240350-e61b-4ebb-9269-b743e4ce215f None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:48.204753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:48.211353 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd240350-e61b-4ebb-9269-b743e4ce215f None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:48.245264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e503d53-f798-4fd8-9693-5e2766486e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:48.246066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e503d53-f798-4fd8-9693-5e2766486e1e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:48.246354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e503d53-f798-4fd8-9693-5e2766486e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:48.246637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e503d53-f798-4fd8-9693-5e2766486e1e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:48.254472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e503d53-f798-4fd8-9693-5e2766486e1e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:48.255949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e503d53-f798-4fd8-9693-5e2766486e1e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-4e503d53-f798-4fd8-9693-5e2766486e1e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:57:48.270597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:48.271753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:48.273203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:48.273203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:48.273203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:57:48.273203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:57:48.273203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:57:48.273203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:57:48.273203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:57:48.273203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:57:48.273203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:48.273203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:48.273203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 609/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:48.278744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cea91c-4054-4750-b67f-6e24297b0303 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:48.325186 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:48.376574 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cea91c-4054-4750-b67f-6e24297b0303 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:48.411192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd4640-1133-4426-a386-66a50590e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:48.411930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd4640-1133-4426-a386-66a50590e857 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:48.412229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd4640-1133-4426-a386-66a50590e857 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:48.412510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd4640-1133-4426-a386-66a50590e857 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:48.413344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd4640-1133-4426-a386-66a50590e857 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:48.413659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd4640-1133-4426-a386-66a50590e857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:48.415139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd4640-1133-4426-a386-66a50590e857 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:48.434451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 618/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 2 09:57:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:48.440325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e503d53-f798-4fd8-9693-5e2766486e1e None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:48.543262 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e503d53-f798-4fd8-9693-5e2766486e1e None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:48.575833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96cd3-d4ec-4fa6-96f6-43cafecb65c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:48.576611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96cd3-d4ec-4fa6-96f6-43cafecb65c9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:48.576897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96cd3-d4ec-4fa6-96f6-43cafecb65c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:48.577172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f96cd3-d4ec-4fa6-96f6-43cafecb65c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:48.587284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f96cd3-d4ec-4fa6-96f6-43cafecb65c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:48.589926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f96cd3-d4ec-4fa6-96f6-43cafecb65c9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-90f96cd3-d4ec-4fa6-96f6-43cafecb65c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:48.606045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:48.607085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:48.608485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:48.608485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:48.608485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:48.608485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:48.608485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 610/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:48.612982 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd4640-1133-4426-a386-66a50590e857 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:48.711306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd4640-1133-4426-a386-66a50590e857 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:48.714253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:48.745775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd9ade-0719-4ca4-8c47-0d56bd28ffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:48.746430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd9ade-0719-4ca4-8c47-0d56bd28ffac None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:48.746718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd9ade-0719-4ca4-8c47-0d56bd28ffac None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:48.746996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd9ade-0719-4ca4-8c47-0d56bd28ffac None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:48.747754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd9ade-0719-4ca4-8c47-0d56bd28ffac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:48.748065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd9ade-0719-4ca4-8c47-0d56bd28ffac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:48.749430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd9ade-0719-4ca4-8c47-0d56bd28ffac None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:48.761896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 619/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:48.767995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96cd3-d4ec-4fa6-96f6-43cafecb65c9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:48.778132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:48.871003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f96cd3-d4ec-4fa6-96f6-43cafecb65c9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:48.904389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba3b12-e11a-4bde-99c7-8c34bbeb507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:48.905180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3b12-e11a-4bde-99c7-8c34bbeb507b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:48.905466 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3b12-e11a-4bde-99c7-8c34bbeb507b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:48.905745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba3b12-e11a-4bde-99c7-8c34bbeb507b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:48.912206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba3b12-e11a-4bde-99c7-8c34bbeb507b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:48.913633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba3b12-e11a-4bde-99c7-8c34bbeb507b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-1cba3b12-e11a-4bde-99c7-8c34bbeb507b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:57:48.928266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:48.929320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:48.930297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:57:48.930297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:57:48.930297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:57:48.930297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:57:48.930297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:57:48.930297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:57:48.930297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:48.930297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:48.930297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 611/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:57:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:48.935464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd9ade-0719-4ca4-8c47-0d56bd28ffac None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:49.035948 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd9ade-0719-4ca4-8c47-0d56bd28ffac None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:49.069200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8a6fa-758f-458f-8bf2-475118c5bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:49.069857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8a6fa-758f-458f-8bf2-475118c5bebf None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:49.070145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8a6fa-758f-458f-8bf2-475118c5bebf None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:49.070425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8a6fa-758f-458f-8bf2-475118c5bebf None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:49.071241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8a6fa-758f-458f-8bf2-475118c5bebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:49.071571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8a6fa-758f-458f-8bf2-475118c5bebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:49.073773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8a6fa-758f-458f-8bf2-475118c5bebf None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:49.085652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 620/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:57:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:49.092383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba3b12-e11a-4bde-99c7-8c34bbeb507b None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:49.157416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:49.189969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba3b12-e11a-4bde-99c7-8c34bbeb507b None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:49.223325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c28205-c5aa-4e0a-89b4-081ca991d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:49.224300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c28205-c5aa-4e0a-89b4-081ca991d0a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:49.224577 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c28205-c5aa-4e0a-89b4-081ca991d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:49.224845 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c28205-c5aa-4e0a-89b4-081ca991d0a1 None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/fbdf5c7049f8499b8a25c88fbf4cb795/roles/441d11583e0f484885b1f24b8eeb28dd` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:49.239701 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c28205-c5aa-4e0a-89b4-081ca991d0a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=fbdf5c7049f8499b8a25c88fbf4cb795, role_id=441d11583e0f484885b1f24b8eeb28dd)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:49.241147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c28205-c5aa-4e0a-89b4-081ca991d0a1 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:49.324175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 612/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:57:49 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/fbdf5c7049f8499b8a25c88fbf4cb795/roles/441d11583e0f484885b1f24b8eeb28dd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:57:51.529145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea6843-644d-4abb-b011-a5536402daaa None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:51.529692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea6843-644d-4abb-b011-a5536402daaa None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:51.529692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea6843-644d-4abb-b011-a5536402daaa None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:51.531087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 621/1233] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:57:51.536641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30590dda-3568-4591-a5aa-a01959be2924 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:51.537015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30590dda-3568-4591-a5aa-a01959be2924 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:51.537200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30590dda-3568-4591-a5aa-a01959be2924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:51.553550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-30590dda-3568-4591-a5aa-a01959be2924 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:57:51.555847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-30590dda-3568-4591-a5aa-a01959be2924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:57:51.620438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 613/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:57:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:57:51.645023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea6843-644d-4abb-b011-a5536402daaa None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:51.670211 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:51.743791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea6843-644d-4abb-b011-a5536402daaa None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:51.779040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12557190-fbba-43f2-a8e0-1cfac08706a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:51.779922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12557190-fbba-43f2-a8e0-1cfac08706a7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:51.780143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12557190-fbba-43f2-a8e0-1cfac08706a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:51.780423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12557190-fbba-43f2-a8e0-1cfac08706a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:51.790313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12557190-fbba-43f2-a8e0-1cfac08706a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-12557190-fbba-43f2-a8e0-1cfac08706a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:57:51.799197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:51.800328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:57:51.801218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 622/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jun 2 09:57:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:51.806487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30590dda-3568-4591-a5aa-a01959be2924 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:51.854571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:51.907805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30590dda-3568-4591-a5aa-a01959be2924 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:51.940727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98873198-41c9-4065-ad0d-44ca9f64024b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:51.941383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98873198-41c9-4065-ad0d-44ca9f64024b None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:51.941663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98873198-41c9-4065-ad0d-44ca9f64024b None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:51.941935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98873198-41c9-4065-ad0d-44ca9f64024b None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:51.942675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98873198-41c9-4065-ad0d-44ca9f64024b None admin] RBAC: Adding query filter params (name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:51.942980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98873198-41c9-4065-ad0d-44ca9f64024b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:51.944387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98873198-41c9-4065-ad0d-44ca9f64024b None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:51.953796 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 614/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jun 2 09:57:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:51.959737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12557190-fbba-43f2-a8e0-1cfac08706a7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:52.044771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:52.060604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12557190-fbba-43f2-a8e0-1cfac08706a7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:52.093526 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0c019-9587-406f-905f-d7886e4b6d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:52.094311 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0c019-9587-406f-905f-d7886e4b6d4e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:52.094602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0c019-9587-406f-905f-d7886e4b6d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:52.094883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0c019-9587-406f-905f-d7886e4b6d4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:52.105771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0c019-9587-406f-905f-d7886e4b6d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:52.107256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0c019-9587-406f-905f-d7886e4b6d4e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-82c0c019-9587-406f-905f-d7886e4b6d4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:52.127855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:52.128804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:52.129766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:52.129766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:52.129766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:52.129766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:57:52.129766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 623/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:52.135803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98873198-41c9-4065-ad0d-44ca9f64024b None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:52.237167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98873198-41c9-4065-ad0d-44ca9f64024b None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:52.247380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:52.270815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ed87-7f64-4b20-a2d5-b9043ee814f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:52.271471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ed87-7f64-4b20-a2d5-b9043ee814f3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:52.271790 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ed87-7f64-4b20-a2d5-b9043ee814f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:52.272070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ed87-7f64-4b20-a2d5-b9043ee814f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:52.273034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ed87-7f64-4b20-a2d5-b9043ee814f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:52.273344 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ed87-7f64-4b20-a2d5-b9043ee814f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:52.274705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ed87-7f64-4b20-a2d5-b9043ee814f3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:52.285648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 615/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:52.291347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0c019-9587-406f-905f-d7886e4b6d4e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:52.388797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0c019-9587-406f-905f-d7886e4b6d4e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:52.422609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645479ba-f750-4fc1-bf67-1ff3205120a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:52.423404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645479ba-f750-4fc1-bf67-1ff3205120a6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:52.423715 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645479ba-f750-4fc1-bf67-1ff3205120a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:52.423991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645479ba-f750-4fc1-bf67-1ff3205120a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:52.426774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:52.431831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645479ba-f750-4fc1-bf67-1ff3205120a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:52.433371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645479ba-f750-4fc1-bf67-1ff3205120a6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-645479ba-f750-4fc1-bf67-1ff3205120a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:57:52.447254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:52.449142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:52.450444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:52.450444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:52.450444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:57:52.450444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:57:52.450444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:57:52.450444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:57:52.450444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:57:52.450444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:57:52.450444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:52.450444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:57:52.450444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 624/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:52.455092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ed87-7f64-4b20-a2d5-b9043ee814f3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:52.555207 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ed87-7f64-4b20-a2d5-b9043ee814f3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:52.587159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15054c-2c65-4a0d-9845-74d520bb0b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:52.587853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15054c-2c65-4a0d-9845-74d520bb0b40 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:52.588139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15054c-2c65-4a0d-9845-74d520bb0b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:52.588415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15054c-2c65-4a0d-9845-74d520bb0b40 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:52.589849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15054c-2c65-4a0d-9845-74d520bb0b40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:52.590214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15054c-2c65-4a0d-9845-74d520bb0b40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:52.591677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15054c-2c65-4a0d-9845-74d520bb0b40 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:52.608964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 616/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 2 09:57:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:52.615085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645479ba-f750-4fc1-bf67-1ff3205120a6 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:52.714864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645479ba-f750-4fc1-bf67-1ff3205120a6 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:52.747929 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efee921-4565-404f-96cc-d64d7ad1b0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:52.748568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efee921-4565-404f-96cc-d64d7ad1b0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:52.748849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efee921-4565-404f-96cc-d64d7ad1b0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:52.749125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efee921-4565-404f-96cc-d64d7ad1b0e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:52.808751 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:52.815155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efee921-4565-404f-96cc-d64d7ad1b0e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:52.816628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efee921-4565-404f-96cc-d64d7ad1b0e3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:52.913256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 625/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:57:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:57:52.920289 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15054c-2c65-4a0d-9845-74d520bb0b40 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:52.947753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:53.017632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15054c-2c65-4a0d-9845-74d520bb0b40 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:53.056965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651315-9851-48de-9608-bc41a24462e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:53.058453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651315-9851-48de-9608-bc41a24462e0 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:53.058832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651315-9851-48de-9608-bc41a24462e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:53.059115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3651315-9851-48de-9608-bc41a24462e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:53.069067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3651315-9851-48de-9608-bc41a24462e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:53.070506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3651315-9851-48de-9608-bc41a24462e0 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-d3651315-9851-48de-9608-bc41a24462e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:53.087813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:53.088762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:53.090283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:53.090283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:53.090283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:53.090283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:53.090283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 617/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:53.094843 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efee921-4565-404f-96cc-d64d7ad1b0e3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:53.187482 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:53.193129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efee921-4565-404f-96cc-d64d7ad1b0e3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:53.225673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc740-774c-4b7b-ba68-9536a14bf2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:53.226371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc740-774c-4b7b-ba68-9536a14bf2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:53.226699 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc740-774c-4b7b-ba68-9536a14bf2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:53.226966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc740-774c-4b7b-ba68-9536a14bf2a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:53.227710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccc740-774c-4b7b-ba68-9536a14bf2a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:53.230719 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccc740-774c-4b7b-ba68-9536a14bf2a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:53.230719 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccc740-774c-4b7b-ba68-9536a14bf2a1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:53.241002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 626/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:53.246951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651315-9851-48de-9608-bc41a24462e0 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:53.323649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:53.344727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3651315-9851-48de-9608-bc41a24462e0 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:53.377551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de911d0-7f1f-4b92-929c-869df422f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:53.378332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de911d0-7f1f-4b92-929c-869df422f79d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:53.378613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de911d0-7f1f-4b92-929c-869df422f79d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:53.378882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de911d0-7f1f-4b92-929c-869df422f79d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:53.385488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de911d0-7f1f-4b92-929c-869df422f79d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:53.387684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de911d0-7f1f-4b92-929c-869df422f79d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-2de911d0-7f1f-4b92-929c-869df422f79d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:57:53.401188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:53.402430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:53.403614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:57:53.403614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:57:53.403614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:57:53.403614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:57:53.403614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:57:53.403614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:57:53.403614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:53.403614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:53.403614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 618/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:57:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:53.408591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc740-774c-4b7b-ba68-9536a14bf2a1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:53.510574 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc740-774c-4b7b-ba68-9536a14bf2a1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:53.545307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b27f3b-834e-48ea-9fbd-d9d75dfcc95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:53.545957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b27f3b-834e-48ea-9fbd-d9d75dfcc95b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:53.546239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b27f3b-834e-48ea-9fbd-d9d75dfcc95b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:53.546515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b27f3b-834e-48ea-9fbd-d9d75dfcc95b None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:53.547289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b27f3b-834e-48ea-9fbd-d9d75dfcc95b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:53.547628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b27f3b-834e-48ea-9fbd-d9d75dfcc95b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:53.549082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b27f3b-834e-48ea-9fbd-d9d75dfcc95b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:53.561475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 627/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:57:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:53.567758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de911d0-7f1f-4b92-929c-869df422f79d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:53.669308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de911d0-7f1f-4b92-929c-869df422f79d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:53.702382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcb87d-9071-4a44-90ea-0a97cfdf45d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:53.703036 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcb87d-9071-4a44-90ea-0a97cfdf45d0 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:53.703319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcb87d-9071-4a44-90ea-0a97cfdf45d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:53.703617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcb87d-9071-4a44-90ea-0a97cfdf45d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:53.704453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcb87d-9071-4a44-90ea-0a97cfdf45d0 None admin] RBAC: Adding query filter params (role.id=441d11583e0f484885b1f24b8eeb28dd, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=fbdf5c7049f8499b8a25c88fbf4cb795) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:53.704774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcb87d-9071-4a44-90ea-0a97cfdf45d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:53.706420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcb87d-9071-4a44-90ea-0a97cfdf45d0 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:53.712213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 619/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:57:53 2022] GET /identity/v3/role_assignments?user.id=fbdf5c7049f8499b8a25c88fbf4cb795&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=441d11583e0f484885b1f24b8eeb28dd => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:56.025346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719c1b5-fe07-4939-9e52-5c0d47238b2a None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:56.025869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719c1b5-fe07-4939-9e52-5c0d47238b2a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:56.025981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719c1b5-fe07-4939-9e52-5c0d47238b2a None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:56.027385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 628/1247] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:57:56.032820 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf331-72ff-4eac-b7be-dba33dd4ff7d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:56.033233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf331-72ff-4eac-b7be-dba33dd4ff7d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:56.033389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf331-72ff-4eac-b7be-dba33dd4ff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:56.038502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:56.051794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-32bcf331-72ff-4eac-b7be-dba33dd4ff7d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:57:56.052982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-32bcf331-72ff-4eac-b7be-dba33dd4ff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:57:56.121638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 620/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:57:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:57:56.145012 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719c1b5-fe07-4939-9e52-5c0d47238b2a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:56.164149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:56.249983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719c1b5-fe07-4939-9e52-5c0d47238b2a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:56.284995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc0a03-2e96-4798-9f7e-a314a8116927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:56.285775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc0a03-2e96-4798-9f7e-a314a8116927 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:56.286061 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc0a03-2e96-4798-9f7e-a314a8116927 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:56.286339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc0a03-2e96-4798-9f7e-a314a8116927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:56.298381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc0a03-2e96-4798-9f7e-a314a8116927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-fbdc0a03-2e96-4798-9f7e-a314a8116927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:57:56.306291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:56.307418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:57:56.312774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 629/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:57:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:56.313732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcf331-72ff-4eac-b7be-dba33dd4ff7d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:56.410060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcf331-72ff-4eac-b7be-dba33dd4ff7d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:56.438087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:56.442806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b252f-7133-44a0-ab37-303494929bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:56.443459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b252f-7133-44a0-ab37-303494929bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:56.443772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b252f-7133-44a0-ab37-303494929bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:56.444065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b252f-7133-44a0-ab37-303494929bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:56.444784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b252f-7133-44a0-ab37-303494929bd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:56.445090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b252f-7133-44a0-ab37-303494929bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:56.446441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b252f-7133-44a0-ab37-303494929bd5 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:56.454355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 621/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:57:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:56.460232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc0a03-2e96-4798-9f7e-a314a8116927 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:56.536419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:56.559370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc0a03-2e96-4798-9f7e-a314a8116927 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:56.591159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fa4fa-3a3a-454e-ad91-3068d7621595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:56.591967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fa4fa-3a3a-454e-ad91-3068d7621595 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:56.592364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fa4fa-3a3a-454e-ad91-3068d7621595 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:56.592643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fa4fa-3a3a-454e-ad91-3068d7621595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:56.603135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fa4fa-3a3a-454e-ad91-3068d7621595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:56.605143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9fa4fa-3a3a-454e-ad91-3068d7621595 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-fb9fa4fa-3a3a-454e-ad91-3068d7621595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:56.623373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:56.624454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:56.625456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:56.625456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:56.625456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:56.625456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:57:56.625456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 630/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:56.630601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b252f-7133-44a0-ab37-303494929bd5 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:56.729313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b252f-7133-44a0-ab37-303494929bd5 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:56.763447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d75ae-304e-4c50-b802-a122ad1a22a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:56.764130 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d75ae-304e-4c50-b802-a122ad1a22a3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:56.764420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d75ae-304e-4c50-b802-a122ad1a22a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:56.764698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d75ae-304e-4c50-b802-a122ad1a22a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:56.765414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d75ae-304e-4c50-b802-a122ad1a22a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:56.765722 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d75ae-304e-4c50-b802-a122ad1a22a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:56.767088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d75ae-304e-4c50-b802-a122ad1a22a3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:56.778749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 622/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:56.784606 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fa4fa-3a3a-454e-ad91-3068d7621595 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:56.887344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fa4fa-3a3a-454e-ad91-3068d7621595 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:56.913031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:56.920902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6b85c-b5a2-4787-9040-071270e253b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:56.921764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b85c-b5a2-4787-9040-071270e253b3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:56.922121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b85c-b5a2-4787-9040-071270e253b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:56.922319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b85c-b5a2-4787-9040-071270e253b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:56.929842 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6b85c-b5a2-4787-9040-071270e253b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:56.933289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6b85c-b5a2-4787-9040-071270e253b3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-91b6b85c-b5a2-4787-9040-071270e253b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:57:56.946315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:56.947494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:56.949402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:56.949402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:56.949402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:57:56.949402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:57:56.949402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:57:56.949402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:57:56.949402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:57:56.949402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:57:56.949402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:57:56.949402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:57:56.949402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 631/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:56.954206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d75ae-304e-4c50-b802-a122ad1a22a3 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:57.008193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:57.050513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d75ae-304e-4c50-b802-a122ad1a22a3 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:57.084508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458431-4e09-4233-8f6c-c0e905b529b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:57.085195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458431-4e09-4233-8f6c-c0e905b529b9 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.085482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458431-4e09-4233-8f6c-c0e905b529b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.085760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5458431-4e09-4233-8f6c-c0e905b529b9 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.086596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458431-4e09-4233-8f6c-c0e905b529b9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:57.086912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458431-4e09-4233-8f6c-c0e905b529b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:57.088414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5458431-4e09-4233-8f6c-c0e905b529b9 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:57.105307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 623/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 2 09:57:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:57.111057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6b85c-b5a2-4787-9040-071270e253b3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:57.210954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6b85c-b5a2-4787-9040-071270e253b3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:57.245035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431225f3-dbf3-453e-bc44-a777be04e7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:57.246241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431225f3-dbf3-453e-bc44-a777be04e7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.246517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431225f3-dbf3-453e-bc44-a777be04e7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.246791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431225f3-dbf3-453e-bc44-a777be04e7e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.301963 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:57.314365 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431225f3-dbf3-453e-bc44-a777be04e7e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:57.315922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431225f3-dbf3-453e-bc44-a777be04e7e3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:57.412575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 632/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:57:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 09:57:57.418961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458431-4e09-4233-8f6c-c0e905b529b9 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:57.521516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5458431-4e09-4233-8f6c-c0e905b529b9 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:57.536004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:57.556506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c66361-0804-4c12-bd15-306fbd48579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:57.557250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66361-0804-4c12-bd15-306fbd48579c None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.557529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66361-0804-4c12-bd15-306fbd48579c None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.557846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c66361-0804-4c12-bd15-306fbd48579c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.567483 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c66361-0804-4c12-bd15-306fbd48579c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:57.568992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c66361-0804-4c12-bd15-306fbd48579c None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-61c66361-0804-4c12-bd15-306fbd48579c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:57:57.586315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:57.588195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:57.590544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:57:57.590544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:57:57.590544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:57:57.590544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:57.590544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 624/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 09:57:57.594881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431225f3-dbf3-453e-bc44-a777be04e7e3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:57.681848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:57.693931 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431225f3-dbf3-453e-bc44-a777be04e7e3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:57.727801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1536-b0db-4ffb-ad52-16a86f670ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:57.728489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1536-b0db-4ffb-ad52-16a86f670ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.728795 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1536-b0db-4ffb-ad52-16a86f670ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.729090 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1536-b0db-4ffb-ad52-16a86f670ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.729795 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d1536-b0db-4ffb-ad52-16a86f670ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:57.730166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d1536-b0db-4ffb-ad52-16a86f670ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:57.731535 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d1536-b0db-4ffb-ad52-16a86f670ff6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:57.742706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 633/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:57:57.749150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c66361-0804-4c12-bd15-306fbd48579c None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:57.847658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c66361-0804-4c12-bd15-306fbd48579c None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:57.881736 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d70ff-4182-4a41-9757-8b023ed032f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:57.882574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d70ff-4182-4a41-9757-8b023ed032f2 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:57.882816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d70ff-4182-4a41-9757-8b023ed032f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:57.883091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d70ff-4182-4a41-9757-8b023ed032f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:57.890048 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d70ff-4182-4a41-9757-8b023ed032f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:57.891488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d70ff-4182-4a41-9757-8b023ed032f2 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-699d70ff-4182-4a41-9757-8b023ed032f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:57:57.905834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:57:57.906900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:57:57.908022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:57:57.908022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:57:57.908022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:57:57.908022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:57:57.908022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:57:57.908022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:57:57.908022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:57:57.908022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:57:57.908022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 625/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:57:57.912972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1536-b0db-4ffb-ad52-16a86f670ff6 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:58.012992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1536-b0db-4ffb-ad52-16a86f670ff6 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:58.046317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef448c2a-64b6-4b62-bf84-bed35add6324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:58.046973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448c2a-64b6-4b62-bf84-bed35add6324 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:58.047256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448c2a-64b6-4b62-bf84-bed35add6324 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:58.047531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef448c2a-64b6-4b62-bf84-bed35add6324 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:58.048350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef448c2a-64b6-4b62-bf84-bed35add6324 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:58.048657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef448c2a-64b6-4b62-bf84-bed35add6324 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:58.050078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef448c2a-64b6-4b62-bf84-bed35add6324 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:58.061952 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 634/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:57:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:57:58.068247 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d70ff-4182-4a41-9757-8b023ed032f2 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:57:58.095076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:57:58.170104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d70ff-4182-4a41-9757-8b023ed032f2 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:57:58.203169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9b6f9-ef32-4e33-aa37-0692b92e4965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:57:58.203851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b6f9-ef32-4e33-aa37-0692b92e4965 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:57:58.204139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b6f9-ef32-4e33-aa37-0692b92e4965 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:57:58.204419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9b6f9-ef32-4e33-aa37-0692b92e4965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:57:58.205252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9b6f9-ef32-4e33-aa37-0692b92e4965 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=fbdf5c7049f8499b8a25c88fbf4cb795) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:57:58.205570 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9b6f9-ef32-4e33-aa37-0692b92e4965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:57:58.207013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9b6f9-ef32-4e33-aa37-0692b92e4965 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:57:58.212641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 626/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:57:58 2022] GET /identity/v3/role_assignments?user.id=fbdf5c7049f8499b8a25c88fbf4cb795&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=918b179f19b6437493eabe5394fa9af0 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:00.503371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35df2ce-716d-46ac-adc9-b72cd4279a4a None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:00.503971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35df2ce-716d-46ac-adc9-b72cd4279a4a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:00.503971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35df2ce-716d-46ac-adc9-b72cd4279a4a None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:00.505319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 635/1261] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:00.510585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf7dc8-569e-4ae7-94de-6279de46aa4b None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:00.511447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf7dc8-569e-4ae7-94de-6279de46aa4b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:00.511781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf7dc8-569e-4ae7-94de-6279de46aa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:00.528984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-4baf7dc8-569e-4ae7-94de-6279de46aa4b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:00.530176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4baf7dc8-569e-4ae7-94de-6279de46aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:00.597566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 627/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:00.621119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35df2ce-716d-46ac-adc9-b72cd4279a4a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:00.631935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:00.721763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35df2ce-716d-46ac-adc9-b72cd4279a4a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:00.755967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e07867-fb74-4a9c-ba2a-c228e4cc53d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:00.756714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07867-fb74-4a9c-ba2a-c228e4cc53d2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:00.757064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07867-fb74-4a9c-ba2a-c228e4cc53d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:00.757340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e07867-fb74-4a9c-ba2a-c228e4cc53d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:00.767408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e07867-fb74-4a9c-ba2a-c228e4cc53d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-d5e07867-fb74-4a9c-ba2a-c228e4cc53d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:58:00.775566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:00.780918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:58:00.781979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 636/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:00.783522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf7dc8-569e-4ae7-94de-6279de46aa4b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:00.802235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:00.885352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf7dc8-569e-4ae7-94de-6279de46aa4b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:00.920297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d8536-e745-4a9a-9854-08c5972b2086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:00.920965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d8536-e745-4a9a-9854-08c5972b2086 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:00.921251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d8536-e745-4a9a-9854-08c5972b2086 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:00.921531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d8536-e745-4a9a-9854-08c5972b2086 None admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:00.922281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d8536-e745-4a9a-9854-08c5972b2086 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:00.922598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d8536-e745-4a9a-9854-08c5972b2086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:00.923984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d8536-e745-4a9a-9854-08c5972b2086 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:00.931811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 628/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:58:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:00.937990 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e07867-fb74-4a9c-ba2a-c228e4cc53d2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:01.006509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:01.040554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e07867-fb74-4a9c-ba2a-c228e4cc53d2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:01.074045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bb831-e057-48e1-9e67-6f555a74b8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:01.074827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bb831-e057-48e1-9e67-6f555a74b8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:01.075815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bb831-e057-48e1-9e67-6f555a74b8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:01.075815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198bb831-e057-48e1-9e67-6f555a74b8a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:01.085847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bb831-e057-48e1-9e67-6f555a74b8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:01.087346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198bb831-e057-48e1-9e67-6f555a74b8a7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-198bb831-e057-48e1-9e67-6f555a74b8a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:01.105055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:01.106170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:01.107464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:01.107464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:01.107464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:01.107464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:58:01.107464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 637/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:01.112054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d8536-e745-4a9a-9854-08c5972b2086 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:01.190724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:01.210256 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d8536-e745-4a9a-9854-08c5972b2086 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:01.243830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dfe02-65ea-4fb4-865c-1a52f80b2aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:01.244491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dfe02-65ea-4fb4-865c-1a52f80b2aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:01.244780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dfe02-65ea-4fb4-865c-1a52f80b2aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:01.245060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dfe02-65ea-4fb4-865c-1a52f80b2aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:01.246184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dfe02-65ea-4fb4-865c-1a52f80b2aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:01.246499 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dfe02-65ea-4fb4-865c-1a52f80b2aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:01.247900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dfe02-65ea-4fb4-865c-1a52f80b2aa8 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:01.260490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 629/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:01.266832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bb831-e057-48e1-9e67-6f555a74b8a7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:01.367311 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198bb831-e057-48e1-9e67-6f555a74b8a7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:01.387854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:01.402173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb49c9-022e-4bb5-a25c-16195dbb770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:01.402986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb49c9-022e-4bb5-a25c-16195dbb770c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:01.403275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb49c9-022e-4bb5-a25c-16195dbb770c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:01.403553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb49c9-022e-4bb5-a25c-16195dbb770c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:01.411103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb49c9-022e-4bb5-a25c-16195dbb770c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:01.412593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb49c9-022e-4bb5-a25c-16195dbb770c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e2cb49c9-022e-4bb5-a25c-16195dbb770c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:58:01.426955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:01.428137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:01.429330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:01.429330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:01.429330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:58:01.429330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:58:01.429330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:58:01.429330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:58:01.429330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:58:01.429330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:58:01.429330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:01.429330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:58:01.429330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 638/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:01.434792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dfe02-65ea-4fb4-865c-1a52f80b2aa8 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:01.534027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dfe02-65ea-4fb4-865c-1a52f80b2aa8 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:01.567336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3641336-9996-48a6-b411-bd0e5d6a9ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:01.568031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641336-9996-48a6-b411-bd0e5d6a9ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:01.568319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641336-9996-48a6-b411-bd0e5d6a9ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:01.568600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641336-9996-48a6-b411-bd0e5d6a9ba2 None admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:01.569435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3641336-9996-48a6-b411-bd0e5d6a9ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:01.569748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3641336-9996-48a6-b411-bd0e5d6a9ba2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:01.571174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3641336-9996-48a6-b411-bd0e5d6a9ba2 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:01.580782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:01.588965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 630/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 2 09:58:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:01.594619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb49c9-022e-4bb5-a25c-16195dbb770c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:01.695127 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb49c9-022e-4bb5-a25c-16195dbb770c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:01.728668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdf097-c231-439e-8d65-5237238bc7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:01.730026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdf097-c231-439e-8d65-5237238bc7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:01.730511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdf097-c231-439e-8d65-5237238bc7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:01.730944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdf097-c231-439e-8d65-5237238bc7c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:01.743824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdf097-c231-439e-8d65-5237238bc7c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:01.746405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdf097-c231-439e-8d65-5237238bc7c2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e2fdf097-c231-439e-8d65-5237238bc7c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:01.763300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:01.764410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:01.765569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:01.765569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:01.765569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:01.765569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:58:01.765569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 639/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:01.770271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3641336-9996-48a6-b411-bd0e5d6a9ba2 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:01.868638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3641336-9996-48a6-b411-bd0e5d6a9ba2 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:01.904705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a040b8-fe1e-4c4a-af6b-26e45d266dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:01.905382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a040b8-fe1e-4c4a-af6b-26e45d266dbc None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:01.905671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a040b8-fe1e-4c4a-af6b-26e45d266dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:01.905953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a040b8-fe1e-4c4a-af6b-26e45d266dbc None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:01.906712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a040b8-fe1e-4c4a-af6b-26e45d266dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:01.907024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a040b8-fe1e-4c4a-af6b-26e45d266dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:01.908425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a040b8-fe1e-4c4a-af6b-26e45d266dbc None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:01.920444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 631/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:01.926223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdf097-c231-439e-8d65-5237238bc7c2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:01.958835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:02.025801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdf097-c231-439e-8d65-5237238bc7c2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:02.060472 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf60d3-c9e2-4212-92aa-2c44b211283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:02.061258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf60d3-c9e2-4212-92aa-2c44b211283f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:02.061541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf60d3-c9e2-4212-92aa-2c44b211283f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:02.061816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf60d3-c9e2-4212-92aa-2c44b211283f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:02.068431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf60d3-c9e2-4212-92aa-2c44b211283f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:02.069976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf60d3-c9e2-4212-92aa-2c44b211283f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-c3bf60d3-c9e2-4212-92aa-2c44b211283f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:58:02.084560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:02.085617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:02.086910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:58:02.086910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:58:02.086910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:58:02.086910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:58:02.086910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:58:02.086910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:58:02.086910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:02.086910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:58:02.086910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 640/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:58:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:02.091490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a040b8-fe1e-4c4a-af6b-26e45d266dbc None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:02.149445 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:02.190555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a040b8-fe1e-4c4a-af6b-26e45d266dbc None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:02.222946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd960a1-137f-44cd-b8ee-d9c8a640b876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:02.223618 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd960a1-137f-44cd-b8ee-d9c8a640b876 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:02.223901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd960a1-137f-44cd-b8ee-d9c8a640b876 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:02.224176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd960a1-137f-44cd-b8ee-d9c8a640b876 None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:02.225007 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd960a1-137f-44cd-b8ee-d9c8a640b876 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:02.225323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd960a1-137f-44cd-b8ee-d9c8a640b876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:02.226740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd960a1-137f-44cd-b8ee-d9c8a640b876 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:02.238905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 632/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:02.244970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf60d3-c9e2-4212-92aa-2c44b211283f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:02.338196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:02.347312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf60d3-c9e2-4212-92aa-2c44b211283f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:02.380296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c786f-d599-4bb3-ad28-9c7d7c184f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:02.381175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c786f-d599-4bb3-ad28-9c7d7c184f32 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:02.381460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c786f-d599-4bb3-ad28-9c7d7c184f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:02.381738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c786f-d599-4bb3-ad28-9c7d7c184f32 None admin] PATH_INFO: `/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/fbdf5c7049f8499b8a25c88fbf4cb795/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:02.383678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c786f-d599-4bb3-ad28-9c7d7c184f32 None admin] RBAC: Authorizing `identity:create_grant(project_id=edd940c54602478f99fa5f4d40e7c7cd, user_id=fbdf5c7049f8499b8a25c88fbf4cb795, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:02.385168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c786f-d599-4bb3-ad28-9c7d7c184f32 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:02.444065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 641/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jun 2 09:58:02 2022] PUT /identity/v3/projects/edd940c54602478f99fa5f4d40e7c7cd/users/fbdf5c7049f8499b8a25c88fbf4cb795/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 09:58:04.679143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14df55-b8f4-496c-8bed-7cfdd387d62b None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:04.679696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14df55-b8f4-496c-8bed-7cfdd387d62b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:04.679819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14df55-b8f4-496c-8bed-7cfdd387d62b None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:04.681139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 633/1274] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:04.686466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38c918-752d-473c-9806-15f6e2967c1b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:04.686845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38c918-752d-473c-9806-15f6e2967c1b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:04.687018 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38c918-752d-473c-9806-15f6e2967c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:04.703673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2d38c918-752d-473c-9806-15f6e2967c1b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:04.704867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2d38c918-752d-473c-9806-15f6e2967c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:04.771030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 642/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:04.795792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14df55-b8f4-496c-8bed-7cfdd387d62b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:04.899556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14df55-b8f4-496c-8bed-7cfdd387d62b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:04.917676 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:04.933800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f1faf-d465-460d-b784-c7ecaabb3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:04.934527 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f1faf-d465-460d-b784-c7ecaabb3d29 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:04.934806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f1faf-d465-460d-b784-c7ecaabb3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:04.935081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f1faf-d465-460d-b784-c7ecaabb3d29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:04.944923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f1faf-d465-460d-b784-c7ecaabb3d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-e71f1faf-d465-460d-b784-c7ecaabb3d29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 09:58:04.953241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:04.956434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:04.957482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 634/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jun 2 09:58:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:04.960874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38c918-752d-473c-9806-15f6e2967c1b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:05.042629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:05.060104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38c918-752d-473c-9806-15f6e2967c1b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:05.094336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572884a0-d8d4-46de-93d6-04cfa634c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:05.095186 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572884a0-d8d4-46de-93d6-04cfa634c54e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:05.095812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572884a0-d8d4-46de-93d6-04cfa634c54e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:05.096125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572884a0-d8d4-46de-93d6-04cfa634c54e None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:05.097259 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572884a0-d8d4-46de-93d6-04cfa634c54e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:05.097695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572884a0-d8d4-46de-93d6-04cfa634c54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:05.099168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572884a0-d8d4-46de-93d6-04cfa634c54e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:05.107297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 643/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jun 2 09:58:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:05.113044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f1faf-d465-460d-b784-c7ecaabb3d29 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:05.213762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f1faf-d465-460d-b784-c7ecaabb3d29 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:05.247420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7468bc-dbd2-4ec1-b0fa-ca43800df43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:05.248226 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7468bc-dbd2-4ec1-b0fa-ca43800df43d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:05.253069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7468bc-dbd2-4ec1-b0fa-ca43800df43d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:05.253069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7468bc-dbd2-4ec1-b0fa-ca43800df43d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:05.259039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7468bc-dbd2-4ec1-b0fa-ca43800df43d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:05.260514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7468bc-dbd2-4ec1-b0fa-ca43800df43d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-bd7468bc-dbd2-4ec1-b0fa-ca43800df43d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:05.278505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:05.282792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:05.283951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:05.283951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:05.283951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:05.283951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:05.283951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 635/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:05.285478 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572884a0-d8d4-46de-93d6-04cfa634c54e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:05.383784 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572884a0-d8d4-46de-93d6-04cfa634c54e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:05.417047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90964e-83da-419a-8ed6-639a7252a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:05.418257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90964e-83da-419a-8ed6-639a7252a5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:05.418545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90964e-83da-419a-8ed6-639a7252a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:05.418822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90964e-83da-419a-8ed6-639a7252a5f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:05.419537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90964e-83da-419a-8ed6-639a7252a5f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:05.419880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90964e-83da-419a-8ed6-639a7252a5f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:05.421236 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90964e-83da-419a-8ed6-639a7252a5f0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:05.432619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 644/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:58:05.438420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7468bc-dbd2-4ec1-b0fa-ca43800df43d None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:05.468793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:05.535951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7468bc-dbd2-4ec1-b0fa-ca43800df43d None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:05.569171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bbe91-e401-4876-b43e-28c1432b4633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:05.569956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bbe91-e401-4876-b43e-28c1432b4633 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:05.570238 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bbe91-e401-4876-b43e-28c1432b4633 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:05.570513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bbe91-e401-4876-b43e-28c1432b4633 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:05.578407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bbe91-e401-4876-b43e-28c1432b4633 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:05.579935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bbe91-e401-4876-b43e-28c1432b4633 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-1c9bbe91-e401-4876-b43e-28c1432b4633 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 09:58:05.594399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:05.596670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:05.597660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:05.597660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:05.597660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 09:58:05.597660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 09:58:05.597660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 09:58:05.597660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 09:58:05.597660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 09:58:05.597660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 09:58:05.597660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 09:58:05.597660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:05.597660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 636/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:05.601490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90964e-83da-419a-8ed6-639a7252a5f0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:05.605387 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:05.700408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90964e-83da-419a-8ed6-639a7252a5f0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:05.734275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2367bde-b66f-470b-82c3-53a127900207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:05.734879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2367bde-b66f-470b-82c3-53a127900207 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:05.735166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2367bde-b66f-470b-82c3-53a127900207 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:05.735447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2367bde-b66f-470b-82c3-53a127900207 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:05.736328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2367bde-b66f-470b-82c3-53a127900207 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:05.736643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2367bde-b66f-470b-82c3-53a127900207 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:05.738106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2367bde-b66f-470b-82c3-53a127900207 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:05.760506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 645/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jun 2 09:58:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:05.762438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bbe91-e401-4876-b43e-28c1432b4633 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:05.854293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:05.865265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bbe91-e401-4876-b43e-28c1432b4633 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:05.903758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08fb3-7b74-42fa-883f-e2519cca5ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:05.904506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08fb3-7b74-42fa-883f-e2519cca5ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:05.904792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08fb3-7b74-42fa-883f-e2519cca5ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:05.905148 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a08fb3-7b74-42fa-883f-e2519cca5ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:05.978665 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a08fb3-7b74-42fa-883f-e2519cca5ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:05.980973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a08fb3-7b74-42fa-883f-e2519cca5ed4 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:06.076521 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:06.093691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 637/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jun 2 09:58:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 09:58:06.095012 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2367bde-b66f-470b-82c3-53a127900207 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:06.162081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:06.204075 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2367bde-b66f-470b-82c3-53a127900207 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:06.241747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcecbf-9c97-4bb8-9aca-3b260e6d6f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:06.243210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcecbf-9c97-4bb8-9aca-3b260e6d6f8c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:06.243210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcecbf-9c97-4bb8-9aca-3b260e6d6f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:06.243515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcecbf-9c97-4bb8-9aca-3b260e6d6f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:06.254453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcecbf-9c97-4bb8-9aca-3b260e6d6f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:06.255967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcecbf-9c97-4bb8-9aca-3b260e6d6f8c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-12bcecbf-9c97-4bb8-9aca-3b260e6d6f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 09:58:06.274570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:06.275571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:06.277120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 09:58:06.277120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 09:58:06.277120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 09:58:06.277120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:58:06.277120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 646/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 09:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:06.282498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08fb3-7b74-42fa-883f-e2519cca5ed4 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:06.385242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a08fb3-7b74-42fa-883f-e2519cca5ed4 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:06.419233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fb8c7-a676-4507-b337-b584214795bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:06.419923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fb8c7-a676-4507-b337-b584214795bf None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:06.420206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fb8c7-a676-4507-b337-b584214795bf None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:06.420474 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fb8c7-a676-4507-b337-b584214795bf None admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:06.421181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fb8c7-a676-4507-b337-b584214795bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:06.421485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fb8c7-a676-4507-b337-b584214795bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:06.422845 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fb8c7-a676-4507-b337-b584214795bf None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:06.434338 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 638/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jun 2 09:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:06.440187 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcecbf-9c97-4bb8-9aca-3b260e6d6f8c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:06.538122 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcecbf-9c97-4bb8-9aca-3b260e6d6f8c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:06.552622 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:06.571773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee1442-ead3-457b-a35a-e6c56f1f1228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:06.572558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee1442-ead3-457b-a35a-e6c56f1f1228 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:06.572838 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee1442-ead3-457b-a35a-e6c56f1f1228 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:06.573109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee1442-ead3-457b-a35a-e6c56f1f1228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:06.580320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee1442-ead3-457b-a35a-e6c56f1f1228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:06.581785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee1442-ead3-457b-a35a-e6c56f1f1228 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-b3ee1442-ead3-457b-a35a-e6c56f1f1228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 09:58:06.597955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:06.599028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:06.600020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 09:58:06.600020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 09:58:06.600020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 09:58:06.600020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 09:58:06.600020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 09:58:06.600020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 09:58:06.600020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 09:58:06.600020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 02 09:58:06.600020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 647/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jun 2 09:58:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:06.605283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fb8c7-a676-4507-b337-b584214795bf None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:06.656553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:06.706405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fb8c7-a676-4507-b337-b584214795bf None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:06.739490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c64cf-11de-46f8-b0c8-f7739391666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:06.740187 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c64cf-11de-46f8-b0c8-f7739391666e None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:06.740471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c64cf-11de-46f8-b0c8-f7739391666e None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:06.740749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c64cf-11de-46f8-b0c8-f7739391666e None admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:06.741523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c64cf-11de-46f8-b0c8-f7739391666e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:06.741834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c64cf-11de-46f8-b0c8-f7739391666e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:06.743259 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c64cf-11de-46f8-b0c8-f7739391666e None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:06.755890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 639/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jun 2 09:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:06.762486 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee1442-ead3-457b-a35a-e6c56f1f1228 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:06.861642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee1442-ead3-457b-a35a-e6c56f1f1228 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:06.895070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb087d-7b58-4846-9e75-7e51738340f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:06.895761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb087d-7b58-4846-9e75-7e51738340f7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:06.896045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb087d-7b58-4846-9e75-7e51738340f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:06.896324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb087d-7b58-4846-9e75-7e51738340f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:06.897153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb087d-7b58-4846-9e75-7e51738340f7 None admin] RBAC: Adding query filter params (role.id=918b179f19b6437493eabe5394fa9af0, scope.project.id=edd940c54602478f99fa5f4d40e7c7cd, user.id=fbdf5c7049f8499b8a25c88fbf4cb795) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:06.897725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb087d-7b58-4846-9e75-7e51738340f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:06.899227 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb087d-7b58-4846-9e75-7e51738340f7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:06.905634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 648/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jun 2 09:58:06 2022] GET /identity/v3/role_assignments?user.id=fbdf5c7049f8499b8a25c88fbf4cb795&scope.project.id=edd940c54602478f99fa5f4d40e7c7cd&role.id=918b179f19b6437493eabe5394fa9af0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:09.161131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774453-7120-49d2-887d-78c5ac339bf7 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:09.161647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774453-7120-49d2-887d-78c5ac339bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:09.161647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec774453-7120-49d2-887d-78c5ac339bf7 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:09.163035 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 640/1288] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:09.168816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb104b-15d9-41ae-a55c-2a47fee5a67c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:09.169225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb104b-15d9-41ae-a55c-2a47fee5a67c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:09.169368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb104b-15d9-41ae-a55c-2a47fee5a67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:09.185937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-22eb104b-15d9-41ae-a55c-2a47fee5a67c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:09.187113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-22eb104b-15d9-41ae-a55c-2a47fee5a67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:09.216035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:09.252185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 649/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:09.275039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774453-7120-49d2-887d-78c5ac339bf7 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:09.375293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec774453-7120-49d2-887d-78c5ac339bf7 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:09.386323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:09.409346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c98a0-a663-44c2-88cd-b0b479392cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:09.410219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c98a0-a663-44c2-88cd-b0b479392cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:09.410510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c98a0-a663-44c2-88cd-b0b479392cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:09.410786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c98a0-a663-44c2-88cd-b0b479392cf6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:09.411485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c98a0-a663-44c2-88cd-b0b479392cf6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:09.412836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c98a0-a663-44c2-88cd-b0b479392cf6 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-4f5c98a0-a663-44c2-88cd-b0b479392cf6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:09.425798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:09.433560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:09.434639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 641/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 2 09:58:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:09.435747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb104b-15d9-41ae-a55c-2a47fee5a67c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:09.530052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb104b-15d9-41ae-a55c-2a47fee5a67c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:09.566266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db7804-018e-4628-ae39-604e0af88459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:09.566924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db7804-018e-4628-ae39-604e0af88459 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:09.567206 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db7804-018e-4628-ae39-604e0af88459 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:09.567479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db7804-018e-4628-ae39-604e0af88459 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:09.568242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db7804-018e-4628-ae39-604e0af88459 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:09.568549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db7804-018e-4628-ae39-604e0af88459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:09.569913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db7804-018e-4628-ae39-604e0af88459 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:09.574761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 650/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jun 2 09:58:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:58:09.580656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c98a0-a663-44c2-88cd-b0b479392cf6 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:09.680698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c98a0-a663-44c2-88cd-b0b479392cf6 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:09.713461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe47e6-5364-4cd3-9dea-f7eca23ec4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:09.714730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe47e6-5364-4cd3-9dea-f7eca23ec4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:09.715108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe47e6-5364-4cd3-9dea-f7eca23ec4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:09.715301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe47e6-5364-4cd3-9dea-f7eca23ec4a3 None admin] PATH_INFO: `/v3/services` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:09.716028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe47e6-5364-4cd3-9dea-f7eca23ec4a3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:09.716335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe47e6-5364-4cd3-9dea-f7eca23ec4a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:09.717689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe47e6-5364-4cd3-9dea-f7eca23ec4a3 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:09.722093 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 642/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jun 2 09:58:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:11.929569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a671-54ce-4493-9a21-7a9b5ea21477 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:11.930110 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a671-54ce-4493-9a21-7a9b5ea21477 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:11.930110 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a671-54ce-4493-9a21-7a9b5ea21477 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:11.931483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 651/1293] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:11.937341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a3c05-10b9-48f5-8aa6-ce571ceec750 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:11.937824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a3c05-10b9-48f5-8aa6-ce571ceec750 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:11.937919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a3c05-10b9-48f5-8aa6-ce571ceec750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:11.955487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-044a3c05-10b9-48f5-8aa6-ce571ceec750 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:11.956814 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-044a3c05-10b9-48f5-8aa6-ce571ceec750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:11.986498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:12.024107 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 643/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:12.048131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7a671-54ce-4493-9a21-7a9b5ea21477 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:12.079990 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:12.149191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7a671-54ce-4493-9a21-7a9b5ea21477 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:12.183924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a14494-c4bc-41cb-b7c0-377ef608d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:12.184845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a14494-c4bc-41cb-b7c0-377ef608d92b None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:12.185135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a14494-c4bc-41cb-b7c0-377ef608d92b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:12.185420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a14494-c4bc-41cb-b7c0-377ef608d92b None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:12.186165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a14494-c4bc-41cb-b7c0-377ef608d92b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:12.187542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a14494-c4bc-41cb-b7c0-377ef608d92b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:12.294914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 652/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jun 2 09:58:12 2022] POST /identity/v3/services => generated 246 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:58:14.571328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7e45-e11d-4a3c-a743-ed84613e585c None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:14.571903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7e45-e11d-4a3c-a743-ed84613e585c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:14.571903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7e45-e11d-4a3c-a743-ed84613e585c None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:14.573319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 644/1296] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:14.578517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6ae8-4cd6-49cc-94f4-95d185fbb398 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:14.578964 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6ae8-4cd6-49cc-94f4-95d185fbb398 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:14.579068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6ae8-4cd6-49cc-94f4-95d185fbb398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:14.595870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c03a6ae8-4cd6-49cc-94f4-95d185fbb398 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:14.597055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c03a6ae8-4cd6-49cc-94f4-95d185fbb398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:14.673154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 653/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:14.696724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e7e45-e11d-4a3c-a743-ed84613e585c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:14.795844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e7e45-e11d-4a3c-a743-ed84613e585c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:14.828658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822727ba-4012-4d18-8daf-69362b65cb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:14.829384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822727ba-4012-4d18-8daf-69362b65cb58 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:14.829665 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822727ba-4012-4d18-8daf-69362b65cb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:14.829940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822727ba-4012-4d18-8daf-69362b65cb58 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:14.830587 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822727ba-4012-4d18-8daf-69362b65cb58 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:14.831973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822727ba-4012-4d18-8daf-69362b65cb58 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-822727ba-4012-4d18-8daf-69362b65cb58 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:14.844264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:14.850369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:14.851489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 645/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 2 09:58:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:14.852530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a6ae8-4cd6-49cc-94f4-95d185fbb398 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:14.871323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:14.949358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a6ae8-4cd6-49cc-94f4-95d185fbb398 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:14.983930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d406f9b-df99-48e8-8c6e-b5aa230905be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:14.984639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d406f9b-df99-48e8-8c6e-b5aa230905be None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:14.991481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d406f9b-df99-48e8-8c6e-b5aa230905be None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:14.991481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d406f9b-df99-48e8-8c6e-b5aa230905be None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:14.991481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d406f9b-df99-48e8-8c6e-b5aa230905be None admin] RBAC: Adding query filter params (name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:14.991481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d406f9b-df99-48e8-8c6e-b5aa230905be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:14.991481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d406f9b-df99-48e8-8c6e-b5aa230905be None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:14.992554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 654/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jun 2 09:58:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 09:58:14.998595 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822727ba-4012-4d18-8daf-69362b65cb58 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:15.030056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:15.098108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822727ba-4012-4d18-8daf-69362b65cb58 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:15.131158 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964bf9d-48ea-4704-abc7-71821fcf572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:15.131839 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964bf9d-48ea-4704-abc7-71821fcf572d None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:15.132125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964bf9d-48ea-4704-abc7-71821fcf572d None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:15.132402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964bf9d-48ea-4704-abc7-71821fcf572d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:15.133235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964bf9d-48ea-4704-abc7-71821fcf572d None admin] RBAC: Adding query filter params (interface=public, service_id=f75c3cd979ac4473b6039ee2bda273e2, region_id=RegionOne) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:15.133553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964bf9d-48ea-4704-abc7-71821fcf572d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:15.134928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964bf9d-48ea-4704-abc7-71821fcf572d None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:15.140030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 646/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jun 2 09:58:14 2022] GET /identity/v3/endpoints?service_id=f75c3cd979ac4473b6039ee2bda273e2&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:15.145716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d406f9b-df99-48e8-8c6e-b5aa230905be None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:15.225776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:15.243760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d406f9b-df99-48e8-8c6e-b5aa230905be None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:15.278109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27962fea-74dd-486a-9dad-83584a334107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:15.278814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27962fea-74dd-486a-9dad-83584a334107 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:15.279102 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27962fea-74dd-486a-9dad-83584a334107 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:15.279381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27962fea-74dd-486a-9dad-83584a334107 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:15.280121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27962fea-74dd-486a-9dad-83584a334107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:15.281486 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27962fea-74dd-486a-9dad-83584a334107 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:15.288165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 655/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jun 2 09:58:15 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 09:58:17.546467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f869-0df3-4dff-a283-272b6a06bf14 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:17.547028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f869-0df3-4dff-a283-272b6a06bf14 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:17.547028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6f869-0df3-4dff-a283-272b6a06bf14 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:17.548442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 647/1302] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 09:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 09:58:17.553824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9973aef-4874-4aab-858f-a4a756279d09 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:17.554267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9973aef-4874-4aab-858f-a4a756279d09 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:17.554440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9973aef-4874-4aab-858f-a4a756279d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:17.571260 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e9973aef-4874-4aab-858f-a4a756279d09 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 09:58:17.572473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e9973aef-4874-4aab-858f-a4a756279d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 09:58:17.639314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 656/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 09:58:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 09:58:17.662024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f869-0df3-4dff-a283-272b6a06bf14 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:17.756437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:17.763073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6f869-0df3-4dff-a283-272b6a06bf14 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:17.796327 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be83b8-e615-4764-afcc-a8c5cfcc5d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:17.797169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be83b8-e615-4764-afcc-a8c5cfcc5d00 None admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:17.797429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be83b8-e615-4764-afcc-a8c5cfcc5d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:17.797707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be83b8-e615-4764-afcc-a8c5cfcc5d00 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:17.798355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be83b8-e615-4764-afcc-a8c5cfcc5d00 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:17.799739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be83b8-e615-4764-afcc-a8c5cfcc5d00 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application [None req-17be83b8-e615-4764-afcc-a8c5cfcc5d00 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 09:58:17.812664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 09:58:17.815034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application with Lock( Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self._enter() Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application return self.creator() Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application created_value = creator( Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: ERROR keystone.server.flask.application Jun 02 09:58:17.816040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 648/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jun 2 09:58:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 09:58:17.820103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9973aef-4874-4aab-858f-a4a756279d09 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:17.898378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:17.922162 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9973aef-4874-4aab-858f-a4a756279d09 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:17.954484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7e3ad-a059-4a57-a4bb-98b451e72bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:17.955148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e3ad-a059-4a57-a4bb-98b451e72bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:17.955435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e3ad-a059-4a57-a4bb-98b451e72bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:17.955743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e3ad-a059-4a57-a4bb-98b451e72bb0 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:17.956452 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7e3ad-a059-4a57-a4bb-98b451e72bb0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 09:58:17.956766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7e3ad-a059-4a57-a4bb-98b451e72bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:17.958136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7e3ad-a059-4a57-a4bb-98b451e72bb0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:17.963245 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 657/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jun 2 09:58:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 09:58:17.972873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be83b8-e615-4764-afcc-a8c5cfcc5d00 None admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 09:58:18.083335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be83b8-e615-4764-afcc-a8c5cfcc5d00 None admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 09:58:18.117457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e078c-28a5-4c53-8174-29f84ed94726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 09:58:18.118125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e078c-28a5-4c53-8174-29f84ed94726 None admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 09:58:18.118416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e078c-28a5-4c53-8174-29f84ed94726 None admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 09:58:18.118698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e078c-28a5-4c53-8174-29f84ed94726 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 09:58:18.119437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e078c-28a5-4c53-8174-29f84ed94726 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 09:58:18.121395 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e078c-28a5-4c53-8174-29f84ed94726 None admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 09:58:18.209039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 649/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jun 2 09:58:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 09:58:28.021010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=30 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 09:58:28.204657 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:03:53.432316 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdebf0-bf24-4b76-b587-272dc0661c44 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:03:53.432852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdebf0-bf24-4b76-b587-272dc0661c44 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:03:53.432852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdebf0-bf24-4b76-b587-272dc0661c44 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:03:53.439353 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8fee4-a7f9-4a4c-8b3e-ef27125051e1 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:03:53.439806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8fee4-a7f9-4a4c-8b3e-ef27125051e1 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:03:53.439888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8fee4-a7f9-4a4c-8b3e-ef27125051e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:03:53.443232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 658/1307] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:03:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:03:53.515479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e9c8fee4-a7f9-4a4c-8b3e-ef27125051e1 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:03:53.516822 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e9c8fee4-a7f9-4a4c-8b3e-ef27125051e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:03:53.663453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 650/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:03:53.721348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f209-cd56-4cc2-a854-42f18cb45f01 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:03:53.721811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f209-cd56-4cc2-a854-42f18cb45f01 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:03:53.722186 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638f209-cd56-4cc2-a854-42f18cb45f01 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:03:53.724592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 659/1309] 10.222.0.48 () {54 vars in 964 bytes} [Thu Jun 2 10:03:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:03:53.732086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a647d79-7d3f-4e4e-9038-89e4d0482cf8 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:03:53.732436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a647d79-7d3f-4e4e-9038-89e4d0482cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:03:53.733048 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a647d79-7d3f-4e4e-9038-89e4d0482cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:03:53.872953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-6a647d79-7d3f-4e4e-9038-89e4d0482cf8 None None] MFA Rules not processed for user `d9263fa2ac534b7b9e5c6658c871da9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:03:53.874492 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6a647d79-7d3f-4e4e-9038-89e4d0482cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:03:53.901611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:03:53.963764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 651/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Jun 2 10:03:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:03:53.969752 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638f209-cd56-4cc2-a854-42f18cb45f01 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:03:53.971502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b638f209-cd56-4cc2-a854-42f18cb45f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:03:54.093548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638f209-cd56-4cc2-a854-42f18cb45f01 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:03:54.170660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832aae35-6e17-4f6e-8bab-0dbf5093ef42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:03:54.171315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aae35-6e17-4f6e-8bab-0dbf5093ef42 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:03:54.171617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aae35-6e17-4f6e-8bab-0dbf5093ef42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:03:54.171893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832aae35-6e17-4f6e-8bab-0dbf5093ef42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:03:54.173534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-832aae35-6e17-4f6e-8bab-0dbf5093ef42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:03:54.229985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:03:54.430061 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832aae35-6e17-4f6e-8bab-0dbf5093ef42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:03:54.431536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832aae35-6e17-4f6e-8bab-0dbf5093ef42 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:03:54.451400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 660/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:03:57.075675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208476cb-b1a0-491c-bd40-bc66230fabe1 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:03:57.076212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208476cb-b1a0-491c-bd40-bc66230fabe1 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:03:57.076212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208476cb-b1a0-491c-bd40-bc66230fabe1 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:03:57.077734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 652/1312] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:03:57.083458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8664-4787-45c2-b64f-5e3730358cf6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:03:57.084134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8664-4787-45c2-b64f-5e3730358cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:03:57.084298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8664-4787-45c2-b64f-5e3730358cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:03:57.173353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9e8f8664-4787-45c2-b64f-5e3730358cf6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:03:57.174570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9e8f8664-4787-45c2-b64f-5e3730358cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:03:57.276623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 661/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:03:57.314556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208476cb-b1a0-491c-bd40-bc66230fabe1 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:03:57.316126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-208476cb-b1a0-491c-bd40-bc66230fabe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:03:57.433726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208476cb-b1a0-491c-bd40-bc66230fabe1 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:03:57.515771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:03:57.518469 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53781ea6-5b05-4139-b056-6a2577dad584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:03:57.519482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781ea6-5b05-4139-b056-6a2577dad584 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:03:57.519818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781ea6-5b05-4139-b056-6a2577dad584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:03:57.520098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53781ea6-5b05-4139-b056-6a2577dad584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:03:57.522524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-53781ea6-5b05-4139-b056-6a2577dad584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:03:57.641854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53781ea6-5b05-4139-b056-6a2577dad584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:03:57.643292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53781ea6-5b05-4139-b056-6a2577dad584 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:03:57.664618 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 653/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:00.387736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3eef3d-8ca4-4540-a5de-3c6812ec5396 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:00.388262 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3eef3d-8ca4-4540-a5de-3c6812ec5396 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:00.388357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3eef3d-8ca4-4540-a5de-3c6812ec5396 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:00.389672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 662/1315] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:00.394754 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954a05-0bed-4a1f-8eda-7107d15a26b7 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:00.395181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954a05-0bed-4a1f-8eda-7107d15a26b7 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:00.395561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954a05-0bed-4a1f-8eda-7107d15a26b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:00.458236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-31954a05-0bed-4a1f-8eda-7107d15a26b7 None None] MFA Rules not processed for user `f4c305238f3a4e6eabfcf2068197c2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:00.460076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-31954a05-0bed-4a1f-8eda-7107d15a26b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:00.509700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:00.554881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 654/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:00.609630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82750f1c-42d8-4d38-8ab0-f8f016885873 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:00.609923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82750f1c-42d8-4d38-8ab0-f8f016885873 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:00.610215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82750f1c-42d8-4d38-8ab0-f8f016885873 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:00.611657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 663/1317] 10.222.0.48 () {54 vars in 964 bytes} [Thu Jun 2 10:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:00.617636 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cf8d5-0a39-4615-9ebc-2ef940649863 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:00.617931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cf8d5-0a39-4615-9ebc-2ef940649863 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:00.618211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cf8d5-0a39-4615-9ebc-2ef940649863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:00.692200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-164cf8d5-0a39-4615-9ebc-2ef940649863 None None] MFA Rules not processed for user `d9263fa2ac534b7b9e5c6658c871da9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:00.693397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-164cf8d5-0a39-4615-9ebc-2ef940649863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:00.766561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 655/1318] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Jun 2 10:04:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:00.777237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82750f1c-42d8-4d38-8ab0-f8f016885873 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:00.778747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-82750f1c-42d8-4d38-8ab0-f8f016885873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:00.789110 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:00.882855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82750f1c-42d8-4d38-8ab0-f8f016885873 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:00.955522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300615ef-83f1-4663-9ffb-121b07c94462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:00.956190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300615ef-83f1-4663-9ffb-121b07c94462 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:00.956468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300615ef-83f1-4663-9ffb-121b07c94462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:00.956739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300615ef-83f1-4663-9ffb-121b07c94462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:00.958356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-300615ef-83f1-4663-9ffb-121b07c94462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:01.019274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:01.066896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300615ef-83f1-4663-9ffb-121b07c94462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:01.069034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300615ef-83f1-4663-9ffb-121b07c94462 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:01.088148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 664/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:04.541723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1d390-86e3-43a5-aa8e-0a7ae10de2cf None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:04.542270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1d390-86e3-43a5-aa8e-0a7ae10de2cf None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:04.542270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1d390-86e3-43a5-aa8e-0a7ae10de2cf None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:04.543681 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 656/1320] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:04.548942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163fb0f-b4c4-4e7b-8b04-f0c0904e5d46 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:04.549345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163fb0f-b4c4-4e7b-8b04-f0c0904e5d46 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:04.549509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163fb0f-b4c4-4e7b-8b04-f0c0904e5d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:04.613792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4163fb0f-b4c4-4e7b-8b04-f0c0904e5d46 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:04.615662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4163fb0f-b4c4-4e7b-8b04-f0c0904e5d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:04.710397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 665/1321] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:04.749194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1d390-86e3-43a5-aa8e-0a7ae10de2cf None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:04.750697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d5c1d390-86e3-43a5-aa8e-0a7ae10de2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:04.800188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:04.852320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1d390-86e3-43a5-aa8e-0a7ae10de2cf None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:04.925821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d810fb-8a33-4d35-b6a9-853f3b1f7be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:04.926468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d810fb-8a33-4d35-b6a9-853f3b1f7be9 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:04.926749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d810fb-8a33-4d35-b6a9-853f3b1f7be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:04.927024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d810fb-8a33-4d35-b6a9-853f3b1f7be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:04.929380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-86d810fb-8a33-4d35-b6a9-853f3b1f7be9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:05.022533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:05.036440 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d810fb-8a33-4d35-b6a9-853f3b1f7be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:05.038573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d810fb-8a33-4d35-b6a9-853f3b1f7be9 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:05.060877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 657/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:08.540704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447688-1178-4722-a315-baeb395fb868 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:08.541302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447688-1178-4722-a315-baeb395fb868 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:08.541302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447688-1178-4722-a315-baeb395fb868 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:08.542635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 666/1323] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:08.547806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed0516-31c5-40b4-b23e-2f23de878c15 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:08.548241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed0516-31c5-40b4-b23e-2f23de878c15 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:08.548377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed0516-31c5-40b4-b23e-2f23de878c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:08.613799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-92ed0516-31c5-40b4-b23e-2f23de878c15 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:08.615086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-92ed0516-31c5-40b4-b23e-2f23de878c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:08.714490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 658/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:08.750566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00447688-1178-4722-a315-baeb395fb868 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:08.752234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-00447688-1178-4722-a315-baeb395fb868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:08.772096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:08.861182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00447688-1178-4722-a315-baeb395fb868 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:08.937065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7b17c-5432-450a-996a-d4a61bd184d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:08.937697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7b17c-5432-450a-996a-d4a61bd184d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:08.937981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7b17c-5432-450a-996a-d4a61bd184d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:08.938257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7b17c-5432-450a-996a-d4a61bd184d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:08.939932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bfa7b17c-5432-450a-996a-d4a61bd184d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:09.014279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:09.054033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7b17c-5432-450a-996a-d4a61bd184d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:09.055512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7b17c-5432-450a-996a-d4a61bd184d7 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:09.077530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 667/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:11.424975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d1b67-d98d-44ff-8096-f4a98d5be612 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:11.425527 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d1b67-d98d-44ff-8096-f4a98d5be612 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:11.425527 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d1b67-d98d-44ff-8096-f4a98d5be612 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:11.427088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 659/1326] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:11.432290 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b95e2-565d-422b-bf33-9c82b32605ed None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:11.432701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b95e2-565d-422b-bf33-9c82b32605ed None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:11.432866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b95e2-565d-422b-bf33-9c82b32605ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:11.497214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-106b95e2-565d-422b-bf33-9c82b32605ed None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:11.498409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-106b95e2-565d-422b-bf33-9c82b32605ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:11.595243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 668/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:11.631372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d1b67-d98d-44ff-8096-f4a98d5be612 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:11.633067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9e1d1b67-d98d-44ff-8096-f4a98d5be612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:11.697681 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:11.741452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d1b67-d98d-44ff-8096-f4a98d5be612 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:11.815539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ff48e-4a9d-4160-b198-72fc54825fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:11.816218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ff48e-4a9d-4160-b198-72fc54825fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:11.816528 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ff48e-4a9d-4160-b198-72fc54825fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:11.816806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ff48e-4a9d-4160-b198-72fc54825fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:11.819562 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-615ff48e-4a9d-4160-b198-72fc54825fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:11.929892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:11.932322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ff48e-4a9d-4160-b198-72fc54825fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:11.933766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ff48e-4a9d-4160-b198-72fc54825fcd service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:11.952076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 660/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:14.316152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8b5bf-8edc-4532-a3de-54d7991b9f94 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:14.316708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8b5bf-8edc-4532-a3de-54d7991b9f94 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:14.316708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8b5bf-8edc-4532-a3de-54d7991b9f94 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:14.318554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 669/1329] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:14.323887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb7f60-7c80-4255-9891-983b4fa0d94a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:14.324314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb7f60-7c80-4255-9891-983b4fa0d94a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:14.324449 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb7f60-7c80-4255-9891-983b4fa0d94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:14.391020 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-cffb7f60-7c80-4255-9891-983b4fa0d94a None None] MFA Rules not processed for user `f4c305238f3a4e6eabfcf2068197c2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:14.392260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-cffb7f60-7c80-4255-9891-983b4fa0d94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:14.490029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 661/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:14.529116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8b5bf-8edc-4532-a3de-54d7991b9f94 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:14.530716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9bf8b5bf-8edc-4532-a3de-54d7991b9f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:14.562284 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:14.638768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8b5bf-8edc-4532-a3de-54d7991b9f94 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:14.714044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8294362-0686-474e-80cd-99bb086c96d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:14.714698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8294362-0686-474e-80cd-99bb086c96d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:14.714987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8294362-0686-474e-80cd-99bb086c96d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:14.715267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8294362-0686-474e-80cd-99bb086c96d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:14.716945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c8294362-0686-474e-80cd-99bb086c96d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:14.796202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:14.829268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8294362-0686-474e-80cd-99bb086c96d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:14.830700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8294362-0686-474e-80cd-99bb086c96d2 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:14.849403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 670/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:17.525131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae34d99-d712-4993-9877-4f0b81cd5585 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:17.525628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae34d99-d712-4993-9877-4f0b81cd5585 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:17.525628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae34d99-d712-4993-9877-4f0b81cd5585 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:17.526941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 662/1332] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:17.532214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5526-bb62-4035-88c4-fc7c4e1ab239 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:17.532604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5526-bb62-4035-88c4-fc7c4e1ab239 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:17.532763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa5526-bb62-4035-88c4-fc7c4e1ab239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:17.604893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-83aa5526-bb62-4035-88c4-fc7c4e1ab239 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:17.606419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-83aa5526-bb62-4035-88c4-fc7c4e1ab239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:17.710581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 671/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:17.746979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae34d99-d712-4993-9877-4f0b81cd5585 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:17.748558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-aae34d99-d712-4993-9877-4f0b81cd5585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:17.820209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:17.857888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae34d99-d712-4993-9877-4f0b81cd5585 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:17.947548 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e18e8-700d-46c5-95b9-8598f55baf5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:17.947886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e18e8-700d-46c5-95b9-8598f55baf5c service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:17.948089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e18e8-700d-46c5-95b9-8598f55baf5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:17.948361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e18e8-700d-46c5-95b9-8598f55baf5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:17.950069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-802e18e8-700d-46c5-95b9-8598f55baf5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:18.067934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e18e8-700d-46c5-95b9-8598f55baf5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:18.069324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e18e8-700d-46c5-95b9-8598f55baf5c service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:18.080192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:18.089135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 663/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:20.400139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6364f4d-8abe-45a9-83c1-8787f6213f48 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:20.400728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6364f4d-8abe-45a9-83c1-8787f6213f48 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:20.400728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6364f4d-8abe-45a9-83c1-8787f6213f48 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:20.402073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 672/1335] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:20.407335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d552fe-a7c1-4d15-9b56-d0f9558ea183 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:20.407771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d552fe-a7c1-4d15-9b56-d0f9558ea183 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:20.407921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d552fe-a7c1-4d15-9b56-d0f9558ea183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:20.472566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e4d552fe-a7c1-4d15-9b56-d0f9558ea183 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:20.474251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e4d552fe-a7c1-4d15-9b56-d0f9558ea183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:20.573299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 664/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:20.613034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6364f4d-8abe-45a9-83c1-8787f6213f48 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:20.615247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c6364f4d-8abe-45a9-83c1-8787f6213f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:20.655745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:20.719664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6364f4d-8abe-45a9-83c1-8787f6213f48 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:20.794090 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd886fa-b017-4227-a5b4-6ddcb8936a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:20.794733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd886fa-b017-4227-a5b4-6ddcb8936a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:20.795016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd886fa-b017-4227-a5b4-6ddcb8936a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:20.795294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd886fa-b017-4227-a5b4-6ddcb8936a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:20.796967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9bd886fa-b017-4227-a5b4-6ddcb8936a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:20.880126 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:20.905975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd886fa-b017-4227-a5b4-6ddcb8936a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:20.907503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd886fa-b017-4227-a5b4-6ddcb8936a55 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:20.926141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 673/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:23.804987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95ef51-db7f-494f-a6cf-1ff46fa024f4 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:23.805520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95ef51-db7f-494f-a6cf-1ff46fa024f4 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:23.805520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95ef51-db7f-494f-a6cf-1ff46fa024f4 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:23.806906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 665/1338] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:23.812131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158d3e-d386-47b5-a856-019b7c05f20e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:23.812639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158d3e-d386-47b5-a856-019b7c05f20e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:23.812745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b158d3e-d386-47b5-a856-019b7c05f20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:23.879963 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1b158d3e-d386-47b5-a856-019b7c05f20e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:23.881272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1b158d3e-d386-47b5-a856-019b7c05f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:23.977809 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 674/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:24.015107 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95ef51-db7f-494f-a6cf-1ff46fa024f4 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:24.017632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6c95ef51-db7f-494f-a6cf-1ff46fa024f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:24.097559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:24.131328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95ef51-db7f-494f-a6cf-1ff46fa024f4 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:24.134955 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd2b78-a6da-4492-b836-00dfdfe62562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:24.135618 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd2b78-a6da-4492-b836-00dfdfe62562 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:24.135905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd2b78-a6da-4492-b836-00dfdfe62562 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:24.136184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd2b78-a6da-4492-b836-00dfdfe62562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:24.137921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ccbd2b78-a6da-4492-b836-00dfdfe62562 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:24.368613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd2b78-a6da-4492-b836-00dfdfe62562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:24.369964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd2b78-a6da-4492-b836-00dfdfe62562 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:24.387912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 666/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:29.102378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9937f90-6578-4ee6-8330-a34013a5f4b4 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:29.102937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9937f90-6578-4ee6-8330-a34013a5f4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:29.102937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9937f90-6578-4ee6-8330-a34013a5f4b4 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:29.104429 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 675/1341] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:29.109471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b43154-300c-42a3-87a6-a23791a43112 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:29.109875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b43154-300c-42a3-87a6-a23791a43112 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:29.110148 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b43154-300c-42a3-87a6-a23791a43112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:29.156783 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-38b43154-300c-42a3-87a6-a23791a43112 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:29.157973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-38b43154-300c-42a3-87a6-a23791a43112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:29.213130 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:29.234647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 667/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:29.273815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9937f90-6578-4ee6-8330-a34013a5f4b4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:29.286379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9937f90-6578-4ee6-8330-a34013a5f4b4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:29.289886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb06744-97a9-4116-8478-189a69632282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:29.290516 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb06744-97a9-4116-8478-189a69632282 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:29.290801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb06744-97a9-4116-8478-189a69632282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:29.291081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb06744-97a9-4116-8478-189a69632282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:29.300085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb06744-97a9-4116-8478-189a69632282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:29.301567 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb06744-97a9-4116-8478-189a69632282 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:29.311159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 676/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:32.481205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0fdfa-782e-4a9b-9bdf-5ddc6007f19b None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:32.481715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0fdfa-782e-4a9b-9bdf-5ddc6007f19b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:32.481715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0fdfa-782e-4a9b-9bdf-5ddc6007f19b None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:32.483039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 668/1344] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:32.488747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c291408-477c-49d5-9e6a-726d19ae3274 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:32.489155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c291408-477c-49d5-9e6a-726d19ae3274 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:32.489418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c291408-477c-49d5-9e6a-726d19ae3274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:32.517608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9c291408-477c-49d5-9e6a-726d19ae3274 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:32.518796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9c291408-477c-49d5-9e6a-726d19ae3274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:32.527496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 677/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:32.564298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0fdfa-782e-4a9b-9bdf-5ddc6007f19b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:32.575314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0fdfa-782e-4a9b-9bdf-5ddc6007f19b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:32.578818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37ac9f-e1e0-4750-a914-2ada656818db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:32.579455 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ac9f-e1e0-4750-a914-2ada656818db service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:32.579779 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ac9f-e1e0-4750-a914-2ada656818db service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:32.580058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ac9f-e1e0-4750-a914-2ada656818db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:32.590477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37ac9f-e1e0-4750-a914-2ada656818db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:32.591951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37ac9f-e1e0-4750-a914-2ada656818db service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:32.601338 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 669/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:04:37.057646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c022c0-c610-4d72-861d-b161c22b80d0 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:37.058134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c022c0-c610-4d72-861d-b161c22b80d0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:37.058237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c022c0-c610-4d72-861d-b161c22b80d0 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:37.059549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 678/1347] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:37.064902 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b722d59-ff35-49c1-9a1b-8e1c90622242 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:37.065288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b722d59-ff35-49c1-9a1b-8e1c90622242 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:37.065454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b722d59-ff35-49c1-9a1b-8e1c90622242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:37.084534 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-3b722d59-ff35-49c1-9a1b-8e1c90622242 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:37.085730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-3b722d59-ff35-49c1-9a1b-8e1c90622242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:37.093963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 670/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:37.131929 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c022c0-c610-4d72-861d-b161c22b80d0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:37.142524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c022c0-c610-4d72-861d-b161c22b80d0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:37.147114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9bb7a-f43f-4e40-93cf-0f2c21d3929e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:37.147771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9bb7a-f43f-4e40-93cf-0f2c21d3929e service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:37.148058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9bb7a-f43f-4e40-93cf-0f2c21d3929e service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:37.148338 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9bb7a-f43f-4e40-93cf-0f2c21d3929e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:37.157226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9bb7a-f43f-4e40-93cf-0f2c21d3929e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:37.158641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9bb7a-f43f-4e40-93cf-0f2c21d3929e service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:37.168109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 679/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:04:42.685377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31118d7-3e87-44b4-9154-b2f3a943096e None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:42.686276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31118d7-3e87-44b4-9154-b2f3a943096e None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:42.686734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31118d7-3e87-44b4-9154-b2f3a943096e None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:42.688646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 671/1350] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:42.693579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c2fb0-34ce-415b-ac9f-c6510d4155f3 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:42.694010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c2fb0-34ce-415b-ac9f-c6510d4155f3 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:42.694117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c2fb0-34ce-415b-ac9f-c6510d4155f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:42.697939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:42.775715 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-404c2fb0-34ce-415b-ac9f-c6510d4155f3 None None] MFA Rules not processed for user `fbdf5c7049f8499b8a25c88fbf4cb795`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:42.777021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-404c2fb0-34ce-415b-ac9f-c6510d4155f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:42.891599 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 680/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:04:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:47.078756 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=15 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:47.249463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2858f51-4e70-4a69-8eff-25767d5ef36c None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:47.249776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2858f51-4e70-4a69-8eff-25767d5ef36c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:47.250052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2858f51-4e70-4a69-8eff-25767d5ef36c None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:47.251631 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 672/1352] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:47.257283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc6c92-9362-4b39-93cb-69e6cd205384 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:47.258831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc6c92-9362-4b39-93cb-69e6cd205384 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:47.260534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc6c92-9362-4b39-93cb-69e6cd205384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:47.281757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a8cc6c92-9362-4b39-93cb-69e6cd205384 None None] MFA Rules not processed for user `fbdf5c7049f8499b8a25c88fbf4cb795`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:47.282970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a8cc6c92-9362-4b39-93cb-69e6cd205384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:47.293432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 681/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:04:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:48.992445 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575ec2-15c3-4b5a-b249-a9dc96c43e3c None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:48.992969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575ec2-15c3-4b5a-b249-a9dc96c43e3c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:48.993120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575ec2-15c3-4b5a-b249-a9dc96c43e3c None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:48.994695 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 673/1354] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:48.999964 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f177e9-606c-40e8-8a80-d6abc4f2ab12 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:49.000375 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f177e9-606c-40e8-8a80-d6abc4f2ab12 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:49.000535 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f177e9-606c-40e8-8a80-d6abc4f2ab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:49.020373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-72f177e9-606c-40e8-8a80-d6abc4f2ab12 None None] MFA Rules not processed for user `fbdf5c7049f8499b8a25c88fbf4cb795`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:49.021573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-72f177e9-606c-40e8-8a80-d6abc4f2ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:49.030352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 682/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:04:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:52.792428 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081ec6-7820-4774-bb10-62918549f57d None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:52.792949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081ec6-7820-4774-bb10-62918549f57d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:52.793220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081ec6-7820-4774-bb10-62918549f57d None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:52.794667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 674/1356] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:04:52.800729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e4e82-6a56-4ccb-acdc-f6c67f207f2b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:52.801161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e4e82-6a56-4ccb-acdc-f6c67f207f2b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:52.801289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e4e82-6a56-4ccb-acdc-f6c67f207f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:52.821423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-478e4e82-6a56-4ccb-acdc-f6c67f207f2b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:52.822624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-478e4e82-6a56-4ccb-acdc-f6c67f207f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:52.832044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 683/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:52.897079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fba28-7fd8-45b7-bebf-1665905162fc None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:52.897583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fba28-7fd8-45b7-bebf-1665905162fc None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:52.898146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fba28-7fd8-45b7-bebf-1665905162fc None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:52.899734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 675/1358] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jun 2 10:04:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:52.915040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2b2c-542d-435d-bfcf-2f6f5753e589 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:52.917306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2b2c-542d-435d-bfcf-2f6f5753e589 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:52.917783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa2b2c-542d-435d-bfcf-2f6f5753e589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:52.978272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-65fa2b2c-542d-435d-bfcf-2f6f5753e589 None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:52.979669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-65fa2b2c-542d-435d-bfcf-2f6f5753e589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:53.040627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:04:53.072876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 684/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jun 2 10:04:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:53.082245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fba28-7fd8-45b7-bebf-1665905162fc None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:53.098471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fba28-7fd8-45b7-bebf-1665905162fc None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:53.106089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e72b73-20e2-4001-bc9b-90e1d2ffde0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:53.106822 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72b73-20e2-4001-bc9b-90e1d2ffde0d service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:53.107172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72b73-20e2-4001-bc9b-90e1d2ffde0d service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:53.108985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72b73-20e2-4001-bc9b-90e1d2ffde0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:53.120143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e72b73-20e2-4001-bc9b-90e1d2ffde0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:53.122145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e72b73-20e2-4001-bc9b-90e1d2ffde0d service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:53.132927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 676/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:55.624981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bb6c4-be84-4b95-b00e-91bbbb630f26 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:55.625517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bb6c4-be84-4b95-b00e-91bbbb630f26 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:55.625517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bb6c4-be84-4b95-b00e-91bbbb630f26 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:55.627055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 685/1361] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:55.632915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db580a11-c9a3-4d32-9fbf-7c355dccd0f3 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:55.633366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db580a11-c9a3-4d32-9fbf-7c355dccd0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:55.633466 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db580a11-c9a3-4d32-9fbf-7c355dccd0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:55.653756 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-db580a11-c9a3-4d32-9fbf-7c355dccd0f3 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:55.654934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-db580a11-c9a3-4d32-9fbf-7c355dccd0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:55.663355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 677/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:55.708135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bb6c4-be84-4b95-b00e-91bbbb630f26 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:55.723507 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bb6c4-be84-4b95-b00e-91bbbb630f26 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:55.729102 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751039c9-d34c-42f1-8494-e12121e557fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:55.729742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751039c9-d34c-42f1-8494-e12121e557fd service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:55.730029 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751039c9-d34c-42f1-8494-e12121e557fd service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:55.730311 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751039c9-d34c-42f1-8494-e12121e557fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:55.740145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751039c9-d34c-42f1-8494-e12121e557fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:55.741759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751039c9-d34c-42f1-8494-e12121e557fd service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:55.751938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 686/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:04:58.471852 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df6d59-0094-4dee-86a7-33151746eb37 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:58.472741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df6d59-0094-4dee-86a7-33151746eb37 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:58.473236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df6d59-0094-4dee-86a7-33151746eb37 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:58.475037 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 678/1364] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:04:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:58.480836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864eb53-efe2-482c-95a9-94a0513538b7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:58.481922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864eb53-efe2-482c-95a9-94a0513538b7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:58.482149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864eb53-efe2-482c-95a9-94a0513538b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:58.502022 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6864eb53-efe2-482c-95a9-94a0513538b7 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:58.503542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6864eb53-efe2-482c-95a9-94a0513538b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:58.523667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 687/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:58.560549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6d691-25a9-46dd-8513-5158a302232d None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:58.561058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6d691-25a9-46dd-8513-5158a302232d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:58.561360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6d691-25a9-46dd-8513-5158a302232d None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:58.562723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 679/1366] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jun 2 10:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:04:58.568562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff3416-73fa-42d2-95b6-7700b8bb09e7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:58.568850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff3416-73fa-42d2-95b6-7700b8bb09e7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:58.569135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff3416-73fa-42d2-95b6-7700b8bb09e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:58.588247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ddff3416-73fa-42d2-95b6-7700b8bb09e7 None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:04:58.589488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ddff3416-73fa-42d2-95b6-7700b8bb09e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:04:58.598634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 688/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jun 2 10:04:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:04:58.606333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6d691-25a9-46dd-8513-5158a302232d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:04:58.620792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6d691-25a9-46dd-8513-5158a302232d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:04:58.626208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3bfaf-a643-4cb3-aa27-e37e2d445f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:04:58.626840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3bfaf-a643-4cb3-aa27-e37e2d445f8d service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:04:58.627939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3bfaf-a643-4cb3-aa27-e37e2d445f8d service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:04:58.628253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3bfaf-a643-4cb3-aa27-e37e2d445f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:04:58.636768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3bfaf-a643-4cb3-aa27-e37e2d445f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:04:58.638358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3bfaf-a643-4cb3-aa27-e37e2d445f8d service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:04:58.648849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 680/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:01.114343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bca6f-da14-4f2f-a65f-61088da9f374 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:01.115373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bca6f-da14-4f2f-a65f-61088da9f374 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:01.115796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bca6f-da14-4f2f-a65f-61088da9f374 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:01.117389 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 689/1369] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:01.122848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238d636-67de-48bc-99c4-a5c834c6bc71 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:01.123274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238d636-67de-48bc-99c4-a5c834c6bc71 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:01.123410 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238d636-67de-48bc-99c4-a5c834c6bc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:01.144727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7238d636-67de-48bc-99c4-a5c834c6bc71 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:01.145911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7238d636-67de-48bc-99c4-a5c834c6bc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:01.154593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 681/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:01.198723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bca6f-da14-4f2f-a65f-61088da9f374 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:01.215364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bca6f-da14-4f2f-a65f-61088da9f374 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:01.221708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd1bdc-40ef-43aa-9636-7e5e095b0768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:01.222487 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd1bdc-40ef-43aa-9636-7e5e095b0768 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:01.222836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd1bdc-40ef-43aa-9636-7e5e095b0768 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:01.224988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd1bdc-40ef-43aa-9636-7e5e095b0768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:01.233831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd1bdc-40ef-43aa-9636-7e5e095b0768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:01.237957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd1bdc-40ef-43aa-9636-7e5e095b0768 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:01.250986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 690/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:01.259662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6dcf7-8d74-4371-9e84-c19e6718575f None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:01.259963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6dcf7-8d74-4371-9e84-c19e6718575f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:01.260248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6dcf7-8d74-4371-9e84-c19e6718575f None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:01.263883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 682/1372] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:05:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:01.268424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7b90-a239-45f0-93e9-e3a8a804f82e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:01.268806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7b90-a239-45f0-93e9-e3a8a804f82e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:01.276754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7b90-a239-45f0-93e9-e3a8a804f82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:01.289220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f17f7b90-a239-45f0-93e9-e3a8a804f82e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:01.290432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f17f7b90-a239-45f0-93e9-e3a8a804f82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:01.298606 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 691/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:01.577783 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0404a-bbe5-47d0-9cde-afb790524534 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:01.578069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0404a-bbe5-47d0-9cde-afb790524534 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:01.578564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0404a-bbe5-47d0-9cde-afb790524534 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:01.580439 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 683/1374] 10.222.0.48 () {54 vars in 963 bytes} [Thu Jun 2 10:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:01.586392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28648c93-baea-4c6d-8374-fb2f0df24a9d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:01.586838 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28648c93-baea-4c6d-8374-fb2f0df24a9d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:01.587132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28648c93-baea-4c6d-8374-fb2f0df24a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:01.643035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-28648c93-baea-4c6d-8374-fb2f0df24a9d None None] MFA Rules not processed for user `0faacba133664123b4046de741073bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:01.644264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-28648c93-baea-4c6d-8374-fb2f0df24a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:01.712310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 692/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Thu Jun 2 10:05:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:01.720197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0404a-bbe5-47d0-9cde-afb790524534 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:01.732393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0404a-bbe5-47d0-9cde-afb790524534 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:01.735940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47691961-57fd-4313-82bb-a024114d8838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:01.736731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691961-57fd-4313-82bb-a024114d8838 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:01.737393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691961-57fd-4313-82bb-a024114d8838 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:01.737694 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47691961-57fd-4313-82bb-a024114d8838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:01.747798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47691961-57fd-4313-82bb-a024114d8838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:01.749577 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47691961-57fd-4313-82bb-a024114d8838 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:01.761320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 684/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:03.709300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa67c5-22d4-4eeb-9595-78637e6c6608 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:03.709859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa67c5-22d4-4eeb-9595-78637e6c6608 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:03.709859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa67c5-22d4-4eeb-9595-78637e6c6608 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:03.711214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 693/1377] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:03.717277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca937f8-474a-4f43-9dcf-2dd2ecb7ac86 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:03.717855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca937f8-474a-4f43-9dcf-2dd2ecb7ac86 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:03.717855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca937f8-474a-4f43-9dcf-2dd2ecb7ac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:03.736996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-3ca937f8-474a-4f43-9dcf-2dd2ecb7ac86 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:03.738305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-3ca937f8-474a-4f43-9dcf-2dd2ecb7ac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:03.746461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 685/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:03.792419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa67c5-22d4-4eeb-9595-78637e6c6608 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:03.808032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa67c5-22d4-4eeb-9595-78637e6c6608 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:03.813513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0955f59-946d-4877-8742-e09dfbcd32a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:03.814836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0955f59-946d-4877-8742-e09dfbcd32a0 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:03.815145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0955f59-946d-4877-8742-e09dfbcd32a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:03.815413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0955f59-946d-4877-8742-e09dfbcd32a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:03.825350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0955f59-946d-4877-8742-e09dfbcd32a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:03.826992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0955f59-946d-4877-8742-e09dfbcd32a0 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:03.838615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 694/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:06.303838 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221570-5367-4b69-adef-9bb5a2e54ae2 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:06.304409 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221570-5367-4b69-adef-9bb5a2e54ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:06.304777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221570-5367-4b69-adef-9bb5a2e54ae2 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:06.306333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 686/1380] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:06.311716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0568b8f-ec71-431b-87c4-9418dad6d7ae None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:06.312138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0568b8f-ec71-431b-87c4-9418dad6d7ae None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:06.312280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0568b8f-ec71-431b-87c4-9418dad6d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:06.331805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a0568b8f-ec71-431b-87c4-9418dad6d7ae None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:06.333005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a0568b8f-ec71-431b-87c4-9418dad6d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:06.341109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 695/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:06.384686 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221570-5367-4b69-adef-9bb5a2e54ae2 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:06.399492 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221570-5367-4b69-adef-9bb5a2e54ae2 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:06.405049 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785166d-92df-47aa-bd89-1e055435ffff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:06.405774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785166d-92df-47aa-bd89-1e055435ffff service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:06.406135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785166d-92df-47aa-bd89-1e055435ffff service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:06.406507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785166d-92df-47aa-bd89-1e055435ffff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:06.415649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785166d-92df-47aa-bd89-1e055435ffff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:06.417304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785166d-92df-47aa-bd89-1e055435ffff service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:06.427817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 687/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:08.832301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303edcc-a416-49d7-9674-fd3ad4c807a7 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:08.832885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303edcc-a416-49d7-9674-fd3ad4c807a7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:08.832885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303edcc-a416-49d7-9674-fd3ad4c807a7 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:08.834228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 696/1383] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:05:08.839905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acae77-186d-4b59-bf5b-8e86ff8b4e88 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:08.840390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acae77-186d-4b59-bf5b-8e86ff8b4e88 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:08.840482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acae77-186d-4b59-bf5b-8e86ff8b4e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:08.858320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f5acae77-186d-4b59-bf5b-8e86ff8b4e88 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:08.859503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f5acae77-186d-4b59-bf5b-8e86ff8b4e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:08.871440 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 688/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:08.914667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303edcc-a416-49d7-9674-fd3ad4c807a7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:08.929938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303edcc-a416-49d7-9674-fd3ad4c807a7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:08.935305 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834697fe-58a0-480c-a841-927a2287f317 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:08.935985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834697fe-58a0-480c-a841-927a2287f317 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:08.936273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834697fe-58a0-480c-a841-927a2287f317 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:08.936551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834697fe-58a0-480c-a841-927a2287f317 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:08.946596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834697fe-58a0-480c-a841-927a2287f317 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:08.948222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834697fe-58a0-480c-a841-927a2287f317 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:08.958725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 697/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:11.545858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189060c0-7496-42c1-9b5c-081dbc9dd57a None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:11.546421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189060c0-7496-42c1-9b5c-081dbc9dd57a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:11.546517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189060c0-7496-42c1-9b5c-081dbc9dd57a None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:11.548001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 689/1386] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:11.553905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73bb05-8d71-4c54-92f9-dace66924078 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:11.554431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73bb05-8d71-4c54-92f9-dace66924078 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:11.554595 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73bb05-8d71-4c54-92f9-dace66924078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:11.573920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3d73bb05-8d71-4c54-92f9-dace66924078 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:11.575112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3d73bb05-8d71-4c54-92f9-dace66924078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:11.582969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 698/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:05:11.627212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189060c0-7496-42c1-9b5c-081dbc9dd57a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:11.643678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189060c0-7496-42c1-9b5c-081dbc9dd57a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:11.649490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9627d9-e3ec-4739-801c-d03fe77c8af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:11.650126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9627d9-e3ec-4739-801c-d03fe77c8af9 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:11.650408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9627d9-e3ec-4739-801c-d03fe77c8af9 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:11.650685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9627d9-e3ec-4739-801c-d03fe77c8af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:11.659621 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9627d9-e3ec-4739-801c-d03fe77c8af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:11.661124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9627d9-e3ec-4739-801c-d03fe77c8af9 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:11.670666 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 690/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:05:14.049200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d48f0-f74d-48b6-ab48-433ecba20302 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:14.049757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d48f0-f74d-48b6-ab48-433ecba20302 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:14.050177 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d48f0-f74d-48b6-ab48-433ecba20302 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:14.052542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 699/1389] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:05:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:14.060305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758f68-a576-47a1-b5b9-6a23b9c24be8 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:14.060723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758f68-a576-47a1-b5b9-6a23b9c24be8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:14.060907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758f68-a576-47a1-b5b9-6a23b9c24be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:14.081119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-2c758f68-a576-47a1-b5b9-6a23b9c24be8 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:14.082324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-2c758f68-a576-47a1-b5b9-6a23b9c24be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:14.090348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 691/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:14.135802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d48f0-f74d-48b6-ab48-433ecba20302 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:14.156537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d48f0-f74d-48b6-ab48-433ecba20302 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:14.162639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe927968-12bf-4cd2-91d8-2b543cb017db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:14.163285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe927968-12bf-4cd2-91d8-2b543cb017db service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:14.163651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe927968-12bf-4cd2-91d8-2b543cb017db service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:14.163918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe927968-12bf-4cd2-91d8-2b543cb017db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:14.172572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe927968-12bf-4cd2-91d8-2b543cb017db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:14.174359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe927968-12bf-4cd2-91d8-2b543cb017db service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:14.184249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 700/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:16.652729 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611271b3-2bda-447d-97de-3f879a5d02ff None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:16.653417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611271b3-2bda-447d-97de-3f879a5d02ff None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:16.653417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611271b3-2bda-447d-97de-3f879a5d02ff None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:16.654824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 692/1392] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:16.661173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791443-6081-4adb-8dba-a61892849664 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:16.661599 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791443-6081-4adb-8dba-a61892849664 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:16.661759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b791443-6081-4adb-8dba-a61892849664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:16.680474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3b791443-6081-4adb-8dba-a61892849664 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:16.681684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3b791443-6081-4adb-8dba-a61892849664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:16.690576 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 701/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:05:16.735282 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611271b3-2bda-447d-97de-3f879a5d02ff None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:16.749537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611271b3-2bda-447d-97de-3f879a5d02ff None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:16.755697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da4b82-2b68-43ca-9e5f-a0883fce4fc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:16.756342 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da4b82-2b68-43ca-9e5f-a0883fce4fc5 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:16.756627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da4b82-2b68-43ca-9e5f-a0883fce4fc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:16.756906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da4b82-2b68-43ca-9e5f-a0883fce4fc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:16.765296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da4b82-2b68-43ca-9e5f-a0883fce4fc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:16.767478 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da4b82-2b68-43ca-9e5f-a0883fce4fc5 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:16.777492 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 693/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:18.223218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ba6a-c4d3-42b7-8fd4-866361d3dffc None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:18.223773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ba6a-c4d3-42b7-8fd4-866361d3dffc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:18.223880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27ba6a-c4d3-42b7-8fd4-866361d3dffc None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:18.225169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 702/1395] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:18.230486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5e6f6-534f-4340-9c69-d967bf77ad32 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:18.230940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5e6f6-534f-4340-9c69-d967bf77ad32 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:18.231171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5e6f6-534f-4340-9c69-d967bf77ad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:18.238174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=52 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:18.249981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-65d5e6f6-534f-4340-9c69-d967bf77ad32 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:18.253295 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-65d5e6f6-534f-4340-9c69-d967bf77ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:18.261846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 694/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:18.318578 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149743b-227b-480e-a53c-1416125dec5b None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:18.318964 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149743b-227b-480e-a53c-1416125dec5b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:18.319257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149743b-227b-480e-a53c-1416125dec5b None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:18.320686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 703/1397] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jun 2 10:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:18.325866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c30b-018f-4e67-acef-41d269dc2c15 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:18.326240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c30b-018f-4e67-acef-41d269dc2c15 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:18.326604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc7c30b-018f-4e67-acef-41d269dc2c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:18.375033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-dcc7c30b-018f-4e67-acef-41d269dc2c15 None None] MFA Rules not processed for user `10d089c711a94b70a198e35443ee7ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:18.376245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-dcc7c30b-018f-4e67-acef-41d269dc2c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:18.433490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 695/1398] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jun 2 10:05:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:18.442252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149743b-227b-480e-a53c-1416125dec5b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:18.452725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149743b-227b-480e-a53c-1416125dec5b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:18.456813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3213641-37c1-4496-81a0-6906010ff953 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d089c711a94b70a198e35443ee7ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:18.459116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213641-37c1-4496-81a0-6906010ff953 service glance] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:18.459116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213641-37c1-4496-81a0-6906010ff953 service glance] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:18.459116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3213641-37c1-4496-81a0-6906010ff953 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:18.466769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3213641-37c1-4496-81a0-6906010ff953 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:18.468210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3213641-37c1-4496-81a0-6906010ff953 service glance] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:18.473089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:18.479827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 704/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:19.118279 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89c27b-23a6-4ad8-86b7-806ecbe583cf None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:19.118580 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89c27b-23a6-4ad8-86b7-806ecbe583cf None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:19.118865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89c27b-23a6-4ad8-86b7-806ecbe583cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:19.168952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-bc89c27b-23a6-4ad8-86b7-806ecbe583cf None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:19.170239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-bc89c27b-23a6-4ad8-86b7-806ecbe583cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:19.239425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 696/1400] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:05:19.242071 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7217-37a1-41fd-a8ef-0642ab23b668 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:19.242522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7217-37a1-41fd-a8ef-0642ab23b668 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:19.242629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed7217-37a1-41fd-a8ef-0642ab23b668 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:19.244018 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 705/1401] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:05:19.249503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fd877-5362-43d8-88e9-36b15413663e None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:19.249602 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fd877-5362-43d8-88e9-36b15413663e None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:19.249916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fd877-5362-43d8-88e9-36b15413663e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:19.272358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-d57fd877-5362-43d8-88e9-36b15413663e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:19.272358 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d57fd877-5362-43d8-88e9-36b15413663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:19.279793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 697/1402] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:05:19.283148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a27c-9c58-4b90-9c91-e62f05587a6b None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:19.283438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a27c-9c58-4b90-9c91-e62f05587a6b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:19.283749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8a27c-9c58-4b90-9c91-e62f05587a6b None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:19.285099 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 706/1403] 10.222.0.48 () {54 vars in 942 bytes} [Thu Jun 2 10:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:19.293234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27195822-c2a7-4fac-9e14-23aa64f1ff38 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:19.293583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27195822-c2a7-4fac-9e14-23aa64f1ff38 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:19.293870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27195822-c2a7-4fac-9e14-23aa64f1ff38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:19.324516 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8a27c-9c58-4b90-9c91-e62f05587a6b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:19.339785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8a27c-9c58-4b90-9c91-e62f05587a6b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:19.345381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011b85c-76cb-46c1-bb10-14ccafad0623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:19.346023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011b85c-76cb-46c1-bb10-14ccafad0623 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:19.346210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-27195822-c2a7-4fac-9e14-23aa64f1ff38 None None] MFA Rules not processed for user `842ffae8f3b04107b994e57bc880b59b`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:19.346336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011b85c-76cb-46c1-bb10-14ccafad0623 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:19.346576 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011b85c-76cb-46c1-bb10-14ccafad0623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:19.347418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-27195822-c2a7-4fac-9e14-23aa64f1ff38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:19.355072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011b85c-76cb-46c1-bb10-14ccafad0623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:19.355824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:19.356661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011b85c-76cb-46c1-bb10-14ccafad0623 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:19.366860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 707/1404] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:05:19.422649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 698/1405] 10.222.0.48 () {58 vars in 1039 bytes} [Thu Jun 2 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:19.432379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011b85c-76cb-46c1-bb10-14ccafad0623 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:19.445292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011b85c-76cb-46c1-bb10-14ccafad0623 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:19.450258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c3cdd-7e13-4703-9106-8ebbb82c0ae4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:19.450893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3cdd-7e13-4703-9106-8ebbb82c0ae4 service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:19.451183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3cdd-7e13-4703-9106-8ebbb82c0ae4 service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:19.451460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c3cdd-7e13-4703-9106-8ebbb82c0ae4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:19.460546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c3cdd-7e13-4703-9106-8ebbb82c0ae4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:19.462125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c3cdd-7e13-4703-9106-8ebbb82c0ae4 service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:19.470905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 708/1406] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:05:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:05:21.770844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fcb77-edc4-4318-93b6-b16a468c6c54 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:21.771401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fcb77-edc4-4318-93b6-b16a468c6c54 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:21.771401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fcb77-edc4-4318-93b6-b16a468c6c54 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:21.772987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 699/1407] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:21.778437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cfc89-e316-4151-be90-f1f9a52f6b35 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:21.778983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cfc89-e316-4151-be90-f1f9a52f6b35 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:21.778983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cfc89-e316-4151-be90-f1f9a52f6b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:21.798081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8e5cfc89-e316-4151-be90-f1f9a52f6b35 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:21.800378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8e5cfc89-e316-4151-be90-f1f9a52f6b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:21.816103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 709/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:21.859149 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fcb77-edc4-4318-93b6-b16a468c6c54 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:21.880489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fcb77-edc4-4318-93b6-b16a468c6c54 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:21.889183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce685d-b319-4dad-b90c-51cd5c13ce32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:21.889849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce685d-b319-4dad-b90c-51cd5c13ce32 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:21.890134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce685d-b319-4dad-b90c-51cd5c13ce32 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:21.890416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce685d-b319-4dad-b90c-51cd5c13ce32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:21.900790 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce685d-b319-4dad-b90c-51cd5c13ce32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:21.902662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce685d-b319-4dad-b90c-51cd5c13ce32 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:21.914088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 700/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:31.792874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=16 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:31.998189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=33 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:05:44.093680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bcf76-34fd-47a9-9192-8b56eb5ad694 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:44.094309 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bcf76-34fd-47a9-9192-8b56eb5ad694 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:44.095065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bcf76-34fd-47a9-9192-8b56eb5ad694 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:44.096368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 710/1410] 10.222.0.48 () {54 vars in 918 bytes} [Thu Jun 2 10:05:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:44.101669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba03db-a508-4e58-a9e4-f04d59d86c2c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:44.102112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba03db-a508-4e58-a9e4-f04d59d86c2c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:44.102215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba03db-a508-4e58-a9e4-f04d59d86c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:44.120764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-50ba03db-a508-4e58-a9e4-f04d59d86c2c None None] MFA Rules not processed for user `fbdf5c7049f8499b8a25c88fbf4cb795`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:44.121876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-50ba03db-a508-4e58-a9e4-f04d59d86c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:44.130343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 701/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jun 2 10:05:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:44.145152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84f9f-3ca3-4ad0-b191-80712435f234 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:44.145438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84f9f-3ca3-4ad0-b191-80712435f234 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:44.145714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce84f9f-3ca3-4ad0-b191-80712435f234 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:44.147053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 711/1412] 10.222.0.48 () {54 vars in 918 bytes} [Thu Jun 2 10:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:44.151539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb904-f9e3-45a5-8401-7190584fae21 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:44.151856 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb904-f9e3-45a5-8401-7190584fae21 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:44.152169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edb904-f9e3-45a5-8401-7190584fae21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:44.170363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-60edb904-f9e3-45a5-8401-7190584fae21 None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:44.171555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-60edb904-f9e3-45a5-8401-7190584fae21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:44.180502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 702/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jun 2 10:05:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:46.952307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a2ad2-1aa8-44e8-b7bb-a04fc9341aca None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:46.952865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a2ad2-1aa8-44e8-b7bb-a04fc9341aca None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:46.952865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a2ad2-1aa8-44e8-b7bb-a04fc9341aca None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:46.954814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:46.960248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c552fe-21d3-4543-b6d0-333e19e523e2 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:46.960663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c552fe-21d3-4543-b6d0-333e19e523e2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:46.960805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c552fe-21d3-4543-b6d0-333e19e523e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:46.978591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-52c552fe-21d3-4543-b6d0-333e19e523e2 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:46.979789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-52c552fe-21d3-4543-b6d0-333e19e523e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:46.987599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:47.030319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a2ad2-1aa8-44e8-b7bb-a04fc9341aca None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:47.044868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a2ad2-1aa8-44e8-b7bb-a04fc9341aca None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:47.050192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14ccc4-c009-454e-9e64-fde56577c800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:47.050815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14ccc4-c009-454e-9e64-fde56577c800 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:47.051097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14ccc4-c009-454e-9e64-fde56577c800 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:47.051371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14ccc4-c009-454e-9e64-fde56577c800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:47.059337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14ccc4-c009-454e-9e64-fde56577c800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:47.060941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14ccc4-c009-454e-9e64-fde56577c800 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:47.070259 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 713/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:48.047340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5651-3b68-4d50-af38-232c5ea29697 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:48.048143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5651-3b68-4d50-af38-232c5ea29697 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:48.048143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c5651-3b68-4d50-af38-232c5ea29697 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:48.049493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:48.054631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6351f-ee47-4abe-9924-b09729a043ef None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:48.055037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6351f-ee47-4abe-9924-b09729a043ef None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:48.055212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6351f-ee47-4abe-9924-b09729a043ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:48.074067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-79a6351f-ee47-4abe-9924-b09729a043ef None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:48.075246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-79a6351f-ee47-4abe-9924-b09729a043ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:48.083436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:48.236398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5651-3b68-4d50-af38-232c5ea29697 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:48.250836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c5651-3b68-4d50-af38-232c5ea29697 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:48.257470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292262a-d917-478d-b88d-95786a5a342a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:48.258463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292262a-d917-478d-b88d-95786a5a342a service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:48.258934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292262a-d917-478d-b88d-95786a5a342a service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:48.259430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292262a-d917-478d-b88d-95786a5a342a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:48.269303 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292262a-d917-478d-b88d-95786a5a342a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:48.270881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292262a-d917-478d-b88d-95786a5a342a service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:48.280246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 705/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:49.225798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6eb48-511a-4504-9905-039f09650e73 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:49.226333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6eb48-511a-4504-9905-039f09650e73 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:49.226333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6eb48-511a-4504-9905-039f09650e73 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:49.227700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:49.232682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffa80c-60ba-42d0-8684-0607e21728e6 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:49.233112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffa80c-60ba-42d0-8684-0607e21728e6 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:49.233245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffa80c-60ba-42d0-8684-0607e21728e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:49.252802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-46ffa80c-60ba-42d0-8684-0607e21728e6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:49.253993 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-46ffa80c-60ba-42d0-8684-0607e21728e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:49.261712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:49.411918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6eb48-511a-4504-9905-039f09650e73 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:49.427265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6eb48-511a-4504-9905-039f09650e73 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:49.432603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a36456-0e4c-40cd-95c1-d8ec3d381f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:49.433395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36456-0e4c-40cd-95c1-d8ec3d381f66 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:49.433600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36456-0e4c-40cd-95c1-d8ec3d381f66 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:49.433882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a36456-0e4c-40cd-95c1-d8ec3d381f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:49.442864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a36456-0e4c-40cd-95c1-d8ec3d381f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:49.444476 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a36456-0e4c-40cd-95c1-d8ec3d381f66 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:49.454257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 716/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:50.357410 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9fee-9176-41a3-87e4-57c28e71c8f3 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:50.358009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9fee-9176-41a3-87e4-57c28e71c8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:50.358009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9fee-9176-41a3-87e4-57c28e71c8f3 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:50.359312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:50.365028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c33764-78a7-44f9-979d-e7cbaaf8223c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:50.365414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c33764-78a7-44f9-979d-e7cbaaf8223c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:50.365596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c33764-78a7-44f9-979d-e7cbaaf8223c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:50.383176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-60c33764-78a7-44f9-979d-e7cbaaf8223c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:50.384386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-60c33764-78a7-44f9-979d-e7cbaaf8223c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:50.392160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:50.541743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d9fee-9176-41a3-87e4-57c28e71c8f3 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:50.556239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d9fee-9176-41a3-87e4-57c28e71c8f3 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:50.561430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde8207-0219-45f4-93fa-8d27df663f3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:50.562059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde8207-0219-45f4-93fa-8d27df663f3e service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:50.562346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde8207-0219-45f4-93fa-8d27df663f3e service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:50.562617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde8207-0219-45f4-93fa-8d27df663f3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:50.570506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde8207-0219-45f4-93fa-8d27df663f3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:50.572106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde8207-0219-45f4-93fa-8d27df663f3e service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:50.581153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 708/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:51.496543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fb8ad-7aad-42e4-b2e9-58969dd13c67 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:51.497264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fb8ad-7aad-42e4-b2e9-58969dd13c67 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:51.497264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fb8ad-7aad-42e4-b2e9-58969dd13c67 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:51.499092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:51.504481 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632808aa-a01d-4986-8bdb-d1836731f66e None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:51.504898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632808aa-a01d-4986-8bdb-d1836731f66e None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:51.505013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632808aa-a01d-4986-8bdb-d1836731f66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:51.523308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-632808aa-a01d-4986-8bdb-d1836731f66e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:51.524518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-632808aa-a01d-4986-8bdb-d1836731f66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:51.532937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:05:51.681222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fb8ad-7aad-42e4-b2e9-58969dd13c67 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:51.695981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fb8ad-7aad-42e4-b2e9-58969dd13c67 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:51.701272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95406a-a5ec-4c24-a649-6e41552ed435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:51.701896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95406a-a5ec-4c24-a649-6e41552ed435 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:51.702178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95406a-a5ec-4c24-a649-6e41552ed435 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:51.702451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95406a-a5ec-4c24-a649-6e41552ed435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:51.710555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95406a-a5ec-4c24-a649-6e41552ed435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:51.712174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95406a-a5ec-4c24-a649-6e41552ed435 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:51.722103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 719/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:52.636113 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9a78-a4b4-43fd-9769-21c562b29099 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:52.636554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9a78-a4b4-43fd-9769-21c562b29099 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:52.636669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f9a78-a4b4-43fd-9769-21c562b29099 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:52.638101 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:52.644100 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22232d35-5770-419e-8612-4ebbd96ed3ce None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:52.644531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22232d35-5770-419e-8612-4ebbd96ed3ce None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:52.644638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22232d35-5770-419e-8612-4ebbd96ed3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:52.662220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-22232d35-5770-419e-8612-4ebbd96ed3ce None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:52.663406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-22232d35-5770-419e-8612-4ebbd96ed3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:52.671060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:52.821962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f9a78-a4b4-43fd-9769-21c562b29099 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:52.836677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f9a78-a4b4-43fd-9769-21c562b29099 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:52.841927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dbb9c-7a88-4acf-b34d-efa89ae2702c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:52.842559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dbb9c-7a88-4acf-b34d-efa89ae2702c service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:52.842843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dbb9c-7a88-4acf-b34d-efa89ae2702c service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:52.843120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dbb9c-7a88-4acf-b34d-efa89ae2702c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:52.851110 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dbb9c-7a88-4acf-b34d-efa89ae2702c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:52.852712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dbb9c-7a88-4acf-b34d-efa89ae2702c service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:52.862256 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 711/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:53.740962 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c2cd-02eb-44ec-a054-b6c58839dc77 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:53.741525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c2cd-02eb-44ec-a054-b6c58839dc77 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:53.741525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c2cd-02eb-44ec-a054-b6c58839dc77 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:53.742898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:53.748022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c2c9c-8128-4c94-b719-ab756f44dddb None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:53.748430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c2c9c-8128-4c94-b719-ab756f44dddb None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:53.748586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c2c9c-8128-4c94-b719-ab756f44dddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:53.766987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-038c2c9c-8128-4c94-b719-ab756f44dddb None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:53.768222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-038c2c9c-8128-4c94-b719-ab756f44dddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:53.776219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:53.927368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c2cd-02eb-44ec-a054-b6c58839dc77 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:53.942468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c2cd-02eb-44ec-a054-b6c58839dc77 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:53.947707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af743d12-671a-4c33-a770-262b26dcd37e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:53.948336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743d12-671a-4c33-a770-262b26dcd37e service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:53.948616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743d12-671a-4c33-a770-262b26dcd37e service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:53.948890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af743d12-671a-4c33-a770-262b26dcd37e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:53.956923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af743d12-671a-4c33-a770-262b26dcd37e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:53.958491 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af743d12-671a-4c33-a770-262b26dcd37e service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:53.967807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 722/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:54.880757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fefbf0-2aa4-41f5-bfd0-3af70026cc47 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:54.881268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fefbf0-2aa4-41f5-bfd0-3af70026cc47 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:54.881375 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fefbf0-2aa4-41f5-bfd0-3af70026cc47 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:54.882691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:05:54.887611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc1702-5bfb-4838-bde3-22741fce7796 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:54.888021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc1702-5bfb-4838-bde3-22741fce7796 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:54.888173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc1702-5bfb-4838-bde3-22741fce7796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:54.906626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b9cc1702-5bfb-4838-bde3-22741fce7796 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:54.907828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b9cc1702-5bfb-4838-bde3-22741fce7796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:54.915322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:55.064706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fefbf0-2aa4-41f5-bfd0-3af70026cc47 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:55.079617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fefbf0-2aa4-41f5-bfd0-3af70026cc47 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:55.085052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a9bc6-dbeb-4f2a-a5ff-83e0d4558a7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:55.085697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a9bc6-dbeb-4f2a-a5ff-83e0d4558a7d service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:55.085985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a9bc6-dbeb-4f2a-a5ff-83e0d4558a7d service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:55.086267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a9bc6-dbeb-4f2a-a5ff-83e0d4558a7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:55.094498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a9bc6-dbeb-4f2a-a5ff-83e0d4558a7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:55.096126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a9bc6-dbeb-4f2a-a5ff-83e0d4558a7d service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:55.105275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 714/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:55.993505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913f119-f4af-4f57-9fa8-d0f6478ac3b5 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:55.994037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913f119-f4af-4f57-9fa8-d0f6478ac3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:55.994155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913f119-f4af-4f57-9fa8-d0f6478ac3b5 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:55.995444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:56.001077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474c54e-1eb2-47c3-8853-cd54d4d1522c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:56.001521 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474c54e-1eb2-47c3-8853-cd54d4d1522c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:56.001616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474c54e-1eb2-47c3-8853-cd54d4d1522c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:56.019639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5474c54e-1eb2-47c3-8853-cd54d4d1522c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:56.020843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5474c54e-1eb2-47c3-8853-cd54d4d1522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:56.028683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:05:56.178817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913f119-f4af-4f57-9fa8-d0f6478ac3b5 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:56.193247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913f119-f4af-4f57-9fa8-d0f6478ac3b5 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:56.198503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fc95f-915f-4d77-bd04-cfbdd192675c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:56.199125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fc95f-915f-4d77-bd04-cfbdd192675c service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:56.199405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fc95f-915f-4d77-bd04-cfbdd192675c service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:56.199704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fc95f-915f-4d77-bd04-cfbdd192675c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:56.207740 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fc95f-915f-4d77-bd04-cfbdd192675c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:56.209308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fc95f-915f-4d77-bd04-cfbdd192675c service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:56.218991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 725/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:05:58.303926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972114-9ea8-4b82-8ca6-6e7a2178b601 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:58.304490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972114-9ea8-4b82-8ca6-6e7a2178b601 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:58.304490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21972114-9ea8-4b82-8ca6-6e7a2178b601 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:58.305869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:05:58.311196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575ca3-99da-4db1-beae-a7dd5d8d01ef None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:58.311661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575ca3-99da-4db1-beae-a7dd5d8d01ef None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:58.311779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac575ca3-99da-4db1-beae-a7dd5d8d01ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:58.329786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ac575ca3-99da-4db1-beae-a7dd5d8d01ef None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:05:58.330966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ac575ca3-99da-4db1-beae-a7dd5d8d01ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:05:58.338714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:05:58.378868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21972114-9ea8-4b82-8ca6-6e7a2178b601 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:05:58.389423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21972114-9ea8-4b82-8ca6-6e7a2178b601 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:05:58.392900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ad3a-aa7d-4c2d-af79-892a30af57fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:05:58.393780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ad3a-aa7d-4c2d-af79-892a30af57fa service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:05:58.394060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ad3a-aa7d-4c2d-af79-892a30af57fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:05:58.394333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ad3a-aa7d-4c2d-af79-892a30af57fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:05:58.402914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4ad3a-aa7d-4c2d-af79-892a30af57fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:05:58.404355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4ad3a-aa7d-4c2d-af79-892a30af57fa service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:05:58.413631 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 717/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:00.824293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251c6b-4fc2-4b4a-aa85-6e86dfed4821 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:00.824881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251c6b-4fc2-4b4a-aa85-6e86dfed4821 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:00.824881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251c6b-4fc2-4b4a-aa85-6e86dfed4821 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:00.826212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:00.832077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7d929-2cfc-444b-9149-7ae58874dd2c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:00.832505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7d929-2cfc-444b-9149-7ae58874dd2c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:00.832629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7d929-2cfc-444b-9149-7ae58874dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:00.850080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a6d7d929-2cfc-444b-9149-7ae58874dd2c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:00.851277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a6d7d929-2cfc-444b-9149-7ae58874dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:00.861895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:00.897509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8251c6b-4fc2-4b4a-aa85-6e86dfed4821 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:00.908539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8251c6b-4fc2-4b4a-aa85-6e86dfed4821 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:00.912339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70892d2-1e58-4624-b6e4-52cba455d189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:00.912974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70892d2-1e58-4624-b6e4-52cba455d189 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:00.913263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70892d2-1e58-4624-b6e4-52cba455d189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:00.913545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70892d2-1e58-4624-b6e4-52cba455d189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:00.922434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70892d2-1e58-4624-b6e4-52cba455d189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:00.923900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70892d2-1e58-4624-b6e4-52cba455d189 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:00.933371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 728/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:03.544416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77425827-4866-4d6e-87d3-9fb21d717e53 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:03.545011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77425827-4866-4d6e-87d3-9fb21d717e53 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:03.545011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77425827-4866-4d6e-87d3-9fb21d717e53 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:03.546356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:03.551789 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4763e-4d22-4dc8-9afa-a29806d231fa None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:03.552173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4763e-4d22-4dc8-9afa-a29806d231fa None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:03.552357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4763e-4d22-4dc8-9afa-a29806d231fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:03.570045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-00e4763e-4d22-4dc8-9afa-a29806d231fa None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:03.571324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-00e4763e-4d22-4dc8-9afa-a29806d231fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:03.580189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:03.621135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77425827-4866-4d6e-87d3-9fb21d717e53 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:03.622893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-77425827-4866-4d6e-87d3-9fb21d717e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:03.636122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77425827-4866-4d6e-87d3-9fb21d717e53 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:03.642092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a73f9-02da-4a97-8d31-6e3aa8dfaafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:03.642806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a73f9-02da-4a97-8d31-6e3aa8dfaafe service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:03.643154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a73f9-02da-4a97-8d31-6e3aa8dfaafe service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:03.643764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a73f9-02da-4a97-8d31-6e3aa8dfaafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:03.653975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a73f9-02da-4a97-8d31-6e3aa8dfaafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:03.656783 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a73f9-02da-4a97-8d31-6e3aa8dfaafe service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:03.669939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 720/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:06.019750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6e562-bfdf-4bf6-8c00-912518c7ecd1 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:06.020352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6e562-bfdf-4bf6-8c00-912518c7ecd1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:06.020352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6e562-bfdf-4bf6-8c00-912518c7ecd1 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:06.021698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:06.026902 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c231c-79df-4ede-be81-54fdc52af824 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:06.027352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c231c-79df-4ede-be81-54fdc52af824 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:06.027466 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c231c-79df-4ede-be81-54fdc52af824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:06.045442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-9d8c231c-79df-4ede-be81-54fdc52af824 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:06.047255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9d8c231c-79df-4ede-be81-54fdc52af824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:06.055022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:06:06.095708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6e562-bfdf-4bf6-8c00-912518c7ecd1 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:06.106393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6e562-bfdf-4bf6-8c00-912518c7ecd1 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:06.111334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e3b41-32cb-42c2-8d93-921d20babca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:06.112009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e3b41-32cb-42c2-8d93-921d20babca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:06.112301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e3b41-32cb-42c2-8d93-921d20babca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:06.112582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e3b41-32cb-42c2-8d93-921d20babca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:06.121537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e3b41-32cb-42c2-8d93-921d20babca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:06.122918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e3b41-32cb-42c2-8d93-921d20babca3 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:06.132770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 731/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:08.414240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fffa9-8d9f-431c-8005-47cb237052ac None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:08.414808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fffa9-8d9f-431c-8005-47cb237052ac None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:08.414808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fffa9-8d9f-431c-8005-47cb237052ac None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:08.416219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:08.421926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459b847-8df9-4674-83d2-a925ec77b5f4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:08.422330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459b847-8df9-4674-83d2-a925ec77b5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:08.422471 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459b847-8df9-4674-83d2-a925ec77b5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:08.439786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6459b847-8df9-4674-83d2-a925ec77b5f4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:08.440975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6459b847-8df9-4674-83d2-a925ec77b5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:08.448666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:08.486946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fffa9-8d9f-431c-8005-47cb237052ac None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:08.497923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fffa9-8d9f-431c-8005-47cb237052ac None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:08.501952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243f4d2-f756-4caa-a06e-977116e03540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:08.502593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243f4d2-f756-4caa-a06e-977116e03540 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:08.503023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243f4d2-f756-4caa-a06e-977116e03540 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:08.503310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243f4d2-f756-4caa-a06e-977116e03540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:08.512391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243f4d2-f756-4caa-a06e-977116e03540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:08.514827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243f4d2-f756-4caa-a06e-977116e03540 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:08.524007 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 723/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:10.891537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7ab9-74c2-42ae-8f5d-1d8f75127a6e None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:10.892052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7ab9-74c2-42ae-8f5d-1d8f75127a6e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:10.892159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7ab9-74c2-42ae-8f5d-1d8f75127a6e None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:10.893754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:10.899078 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba91ae-529e-4cf7-a1d4-673cffed8ac6 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:10.899490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba91ae-529e-4cf7-a1d4-673cffed8ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:10.899681 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba91ae-529e-4cf7-a1d4-673cffed8ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:10.917480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-71ba91ae-529e-4cf7-a1d4-673cffed8ac6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:10.918686 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-71ba91ae-529e-4cf7-a1d4-673cffed8ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:10.927246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:10.965293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7ab9-74c2-42ae-8f5d-1d8f75127a6e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:10.975724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7ab9-74c2-42ae-8f5d-1d8f75127a6e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:10.979098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68f322-75b5-4357-a152-f611a1ee4b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:10.979759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68f322-75b5-4357-a152-f611a1ee4b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:10.980041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68f322-75b5-4357-a152-f611a1ee4b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:10.980315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68f322-75b5-4357-a152-f611a1ee4b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:10.989670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68f322-75b5-4357-a152-f611a1ee4b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:10.991089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68f322-75b5-4357-a152-f611a1ee4b89 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:11.000909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 734/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:13.255561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656bf41-b79f-4ebc-993f-5c2e8d466424 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:13.256135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656bf41-b79f-4ebc-993f-5c2e8d466424 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:13.256135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656bf41-b79f-4ebc-993f-5c2e8d466424 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:13.257464 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:06:13.262857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f972baa-5d5c-4a50-aa34-58efce71bca5 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:13.263251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f972baa-5d5c-4a50-aa34-58efce71bca5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:13.263423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f972baa-5d5c-4a50-aa34-58efce71bca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:13.270043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=70 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:06:13.282065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2f972baa-5d5c-4a50-aa34-58efce71bca5 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:13.283432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2f972baa-5d5c-4a50-aa34-58efce71bca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:13.291215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:13.328947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656bf41-b79f-4ebc-993f-5c2e8d466424 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:13.334276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=73 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:06:13.339871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656bf41-b79f-4ebc-993f-5c2e8d466424 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:13.343720 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3220c09-1077-4cd8-80cf-b997218315a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:13.346962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220c09-1077-4cd8-80cf-b997218315a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:13.346962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220c09-1077-4cd8-80cf-b997218315a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:13.346962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3220c09-1077-4cd8-80cf-b997218315a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:13.353832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3220c09-1077-4cd8-80cf-b997218315a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:13.355269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3220c09-1077-4cd8-80cf-b997218315a7 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:13.365774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 726/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:06:15.637661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46b111-fe62-4557-84f1-9aa47eebed66 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:15.638154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46b111-fe62-4557-84f1-9aa47eebed66 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:15.638263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46b111-fe62-4557-84f1-9aa47eebed66 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:15.639722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:15.645412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0af752-6819-4b57-9515-f6b71dc1603e None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:15.645841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0af752-6819-4b57-9515-f6b71dc1603e None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:15.645956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0af752-6819-4b57-9515-f6b71dc1603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:15.663493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-fb0af752-6819-4b57-9515-f6b71dc1603e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:15.664718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-fb0af752-6819-4b57-9515-f6b71dc1603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:15.672890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:15.711266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46b111-fe62-4557-84f1-9aa47eebed66 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:15.722667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46b111-fe62-4557-84f1-9aa47eebed66 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:15.726322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456f99d-5d71-476e-a6a8-7a91c9df5ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:15.726977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456f99d-5d71-476e-a6a8-7a91c9df5ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:15.727264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456f99d-5d71-476e-a6a8-7a91c9df5ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:15.727546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456f99d-5d71-476e-a6a8-7a91c9df5ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:15.738021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456f99d-5d71-476e-a6a8-7a91c9df5ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:15.739464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456f99d-5d71-476e-a6a8-7a91c9df5ed0 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:15.749614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 737/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:18.003060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1a4a-35db-42f9-9df9-d4e222208080 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:18.003638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1a4a-35db-42f9-9df9-d4e222208080 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:18.003638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f1a4a-35db-42f9-9df9-d4e222208080 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:18.005022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:18.010271 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7c04-a5c2-4bd0-a906-dc0a45b2824a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:18.010674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7c04-a5c2-4bd0-a906-dc0a45b2824a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:18.011009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba7c04-a5c2-4bd0-a906-dc0a45b2824a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:18.029423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6bba7c04-a5c2-4bd0-a906-dc0a45b2824a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:18.030721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6bba7c04-a5c2-4bd0-a906-dc0a45b2824a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:18.038524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:18.075061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1a4a-35db-42f9-9df9-d4e222208080 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:18.087523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f1a4a-35db-42f9-9df9-d4e222208080 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:18.091039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207f2f1-e5a9-4a52-a70f-5ba35e050f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:18.091697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207f2f1-e5a9-4a52-a70f-5ba35e050f16 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:18.091981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207f2f1-e5a9-4a52-a70f-5ba35e050f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:18.092324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207f2f1-e5a9-4a52-a70f-5ba35e050f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:18.101336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207f2f1-e5a9-4a52-a70f-5ba35e050f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:18.102772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207f2f1-e5a9-4a52-a70f-5ba35e050f16 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:18.112263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 729/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:20.378264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55884455-d89b-41ed-b7ce-5eca9781a2d8 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:20.378829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55884455-d89b-41ed-b7ce-5eca9781a2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:20.378829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55884455-d89b-41ed-b7ce-5eca9781a2d8 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:20.380251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:20.385498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff62a-f9ef-4cb5-a4a4-03faa3c1927a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:20.385942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff62a-f9ef-4cb5-a4a4-03faa3c1927a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:20.386042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ff62a-f9ef-4cb5-a4a4-03faa3c1927a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:20.403926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-133ff62a-f9ef-4cb5-a4a4-03faa3c1927a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:20.406085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-133ff62a-f9ef-4cb5-a4a4-03faa3c1927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:20.414271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:20.450874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55884455-d89b-41ed-b7ce-5eca9781a2d8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:20.461766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55884455-d89b-41ed-b7ce-5eca9781a2d8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:20.465311 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb390c42-8c61-48ca-a86a-74d0de5a0300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:20.465946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb390c42-8c61-48ca-a86a-74d0de5a0300 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:20.466231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb390c42-8c61-48ca-a86a-74d0de5a0300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:20.466509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb390c42-8c61-48ca-a86a-74d0de5a0300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:20.476169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb390c42-8c61-48ca-a86a-74d0de5a0300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:20.477620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb390c42-8c61-48ca-a86a-74d0de5a0300 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:20.488103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 740/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:30.398720 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=17 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:06:30.482848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=17 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:06:52.766040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55557f46-cc29-4076-8dbf-f9fe57562200 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:52.766667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55557f46-cc29-4076-8dbf-f9fe57562200 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:52.766667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55557f46-cc29-4076-8dbf-f9fe57562200 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:52.768299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 731/1471] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:06:52.773709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72052d-94a8-47ff-84c0-32dc9f1b5796 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:52.774149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72052d-94a8-47ff-84c0-32dc9f1b5796 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:52.774259 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72052d-94a8-47ff-84c0-32dc9f1b5796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:52.791870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8e72052d-94a8-47ff-84c0-32dc9f1b5796 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:52.793069 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8e72052d-94a8-47ff-84c0-32dc9f1b5796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:52.801083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 741/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:52.849211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262dcb-f7a3-49cd-876c-2e523f65cbfd None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:52.849502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262dcb-f7a3-49cd-876c-2e523f65cbfd None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:52.849784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262dcb-f7a3-49cd-876c-2e523f65cbfd None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:52.851142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 732/1473] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jun 2 10:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:52.856529 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0694e80-b8c7-44a7-8a60-05f40a8d273a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:52.856824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0694e80-b8c7-44a7-8a60-05f40a8d273a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:52.857111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0694e80-b8c7-44a7-8a60-05f40a8d273a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:52.875691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d0694e80-b8c7-44a7-8a60-05f40a8d273a None None] MFA Rules not processed for user `10d089c711a94b70a198e35443ee7ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:52.876901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d0694e80-b8c7-44a7-8a60-05f40a8d273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:52.883339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 742/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jun 2 10:06:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:52.891738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd262dcb-f7a3-49cd-876c-2e523f65cbfd None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:52.902506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd262dcb-f7a3-49cd-876c-2e523f65cbfd None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:52.906897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55803932-a88c-481f-8ba0-6a4d521cbd1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d089c711a94b70a198e35443ee7ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:52.907536 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55803932-a88c-481f-8ba0-6a4d521cbd1b service glance] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:52.907867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55803932-a88c-481f-8ba0-6a4d521cbd1b service glance] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:52.908152 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55803932-a88c-481f-8ba0-6a4d521cbd1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:52.931244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55803932-a88c-481f-8ba0-6a4d521cbd1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:52.931244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55803932-a88c-481f-8ba0-6a4d521cbd1b service glance] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:52.931244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 733/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:06:55.289618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db86f1-6f6d-49c5-8fb9-e9a754181add None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:55.290131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db86f1-6f6d-49c5-8fb9-e9a754181add None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:55.290239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db86f1-6f6d-49c5-8fb9-e9a754181add None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:55.291749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 743/1476] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:55.297197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6921c-5ac0-4ef6-99a6-9d3774f6ecb0 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:55.297603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6921c-5ac0-4ef6-99a6-9d3774f6ecb0 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:55.297848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6921c-5ac0-4ef6-99a6-9d3774f6ecb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:55.316071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-0af6921c-5ac0-4ef6-99a6-9d3774f6ecb0 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:55.317269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-0af6921c-5ac0-4ef6-99a6-9d3774f6ecb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:55.325690 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 734/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:55.349664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db86f1-6f6d-49c5-8fb9-e9a754181add None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:55.362398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db86f1-6f6d-49c5-8fb9-e9a754181add None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:55.366777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dd3ab-770d-4926-b4c9-09dc059bba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:55.367444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dd3ab-770d-4926-b4c9-09dc059bba11 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:55.367771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dd3ab-770d-4926-b4c9-09dc059bba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:55.368052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dd3ab-770d-4926-b4c9-09dc059bba11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:55.368783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dd3ab-770d-4926-b4c9-09dc059bba11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:55.370508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-513dd3ab-770d-4926-b4c9-09dc059bba11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:06:55.370508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 02 10:06:55.370508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: Jun 02 10:06:55.371793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513dd3ab-770d-4926-b4c9-09dc059bba11 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:55.391530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 744/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jun 2 10:06:55 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:06:57.629405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7821f6a-1567-4fad-9578-359695ff0b4f None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:57.629984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7821f6a-1567-4fad-9578-359695ff0b4f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:57.629984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7821f6a-1567-4fad-9578-359695ff0b4f None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:57.631313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 735/1479] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:06:57.637289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3f22-194f-49a0-a1a4-1c2f4910d339 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:57.637705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3f22-194f-49a0-a1a4-1c2f4910d339 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:57.637853 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f3f22-194f-49a0-a1a4-1c2f4910d339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:57.657074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6a8f3f22-194f-49a0-a1a4-1c2f4910d339 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:06:57.658260 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6a8f3f22-194f-49a0-a1a4-1c2f4910d339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:06:57.665793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 745/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:06:57.709698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7821f6a-1567-4fad-9578-359695ff0b4f None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:06:57.724772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7821f6a-1567-4fad-9578-359695ff0b4f None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:06:57.730153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2049bf-63d3-43ae-aad5-a6d6e93b1ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:06:57.730790 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2049bf-63d3-43ae-aad5-a6d6e93b1ef8 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:06:57.731070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2049bf-63d3-43ae-aad5-a6d6e93b1ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:06:57.731347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2049bf-63d3-43ae-aad5-a6d6e93b1ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:06:57.739520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2049bf-63d3-43ae-aad5-a6d6e93b1ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:06:57.741120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2049bf-63d3-43ae-aad5-a6d6e93b1ef8 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:06:57.750806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 736/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:07:00.178047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73112c2c-0fb4-4ab7-9861-a458180c9ba4 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:00.178610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73112c2c-0fb4-4ab7-9861-a458180c9ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:00.178610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73112c2c-0fb4-4ab7-9861-a458180c9ba4 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:00.180006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 746/1482] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:07:00.185837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268a322-6694-4254-8324-1573137c2aeb None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:00.186269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268a322-6694-4254-8324-1573137c2aeb None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:00.186388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268a322-6694-4254-8324-1573137c2aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:00.204510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-0268a322-6694-4254-8324-1573137c2aeb None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:00.205704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-0268a322-6694-4254-8324-1573137c2aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:00.213407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 737/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:07:00.250078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73112c2c-0fb4-4ab7-9861-a458180c9ba4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:07:00.260610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73112c2c-0fb4-4ab7-9861-a458180c9ba4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:07:00.264975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a6a02-68be-4c2e-a7e8-b5d2a7cd7f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:07:00.265604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a6a02-68be-4c2e-a7e8-b5d2a7cd7f81 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:00.265890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a6a02-68be-4c2e-a7e8-b5d2a7cd7f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:00.266170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a6a02-68be-4c2e-a7e8-b5d2a7cd7f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:00.275196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a6a02-68be-4c2e-a7e8-b5d2a7cd7f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:07:00.276663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a6a02-68be-4c2e-a7e8-b5d2a7cd7f81 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:07:00.286285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 747/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:07:02.619637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43e231-89af-4344-9ef7-82e0ed63aac8 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:02.620183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43e231-89af-4344-9ef7-82e0ed63aac8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:02.620183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43e231-89af-4344-9ef7-82e0ed63aac8 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:02.622450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 738/1485] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:07:02.627705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f128f4-2b5a-4950-a31b-a073548dca86 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:02.628113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f128f4-2b5a-4950-a31b-a073548dca86 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:02.628270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f128f4-2b5a-4950-a31b-a073548dca86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:02.646956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-51f128f4-2b5a-4950-a31b-a073548dca86 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:02.648179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-51f128f4-2b5a-4950-a31b-a073548dca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:02.656181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 748/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:07:02.695096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43e231-89af-4344-9ef7-82e0ed63aac8 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:07:02.705626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43e231-89af-4344-9ef7-82e0ed63aac8 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:07:02.709422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71a027-ddda-4719-aa15-9df0eeb672e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:07:02.710052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71a027-ddda-4719-aa15-9df0eeb672e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:02.710333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71a027-ddda-4719-aa15-9df0eeb672e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:02.710606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71a027-ddda-4719-aa15-9df0eeb672e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:02.719392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71a027-ddda-4719-aa15-9df0eeb672e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:07:02.720860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71a027-ddda-4719-aa15-9df0eeb672e3 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:07:02.730823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 739/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:07:05.043034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419b60-4e2c-4fc3-8bab-5b0ef059cc6c None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:05.043677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419b60-4e2c-4fc3-8bab-5b0ef059cc6c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:05.043677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419b60-4e2c-4fc3-8bab-5b0ef059cc6c None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:05.045033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 749/1488] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:07:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:07:05.050723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac5fdf-af13-4da2-a01f-fc80a9ec9cc8 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:05.051611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac5fdf-af13-4da2-a01f-fc80a9ec9cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:05.051611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac5fdf-af13-4da2-a01f-fc80a9ec9cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:05.069886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-bdac5fdf-af13-4da2-a01f-fc80a9ec9cc8 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:05.090461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-bdac5fdf-af13-4da2-a01f-fc80a9ec9cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:05.090461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 740/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:07:05.122567 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4419b60-4e2c-4fc3-8bab-5b0ef059cc6c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:07:05.133419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4419b60-4e2c-4fc3-8bab-5b0ef059cc6c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:07:05.137444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fd2dc-738d-4e85-9ad8-b1b329baec5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:07:05.138066 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fd2dc-738d-4e85-9ad8-b1b329baec5d service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:05.138350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fd2dc-738d-4e85-9ad8-b1b329baec5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:05.138627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fd2dc-738d-4e85-9ad8-b1b329baec5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:05.147706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fd2dc-738d-4e85-9ad8-b1b329baec5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:07:05.149147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fd2dc-738d-4e85-9ad8-b1b329baec5d service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:07:05.159055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 750/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:07:07.844651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a214-d1a7-4da7-af9e-d914478f2199 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:07.845209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a214-d1a7-4da7-af9e-d914478f2199 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:07.845209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a214-d1a7-4da7-af9e-d914478f2199 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:07.846607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 741/1491] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jun 2 10:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:07:07.851956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3d58-6c51-4f2a-8044-1272eeb05b5c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:07.852404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3d58-6c51-4f2a-8044-1272eeb05b5c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:07.852518 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a3d58-6c51-4f2a-8044-1272eeb05b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:07.871619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-535a3d58-6c51-4f2a-8044-1272eeb05b5c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:07:07.872824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-535a3d58-6c51-4f2a-8044-1272eeb05b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:07:07.880791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 751/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jun 2 10:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:07:07.920658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a214-d1a7-4da7-af9e-d914478f2199 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:07:07.931104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a214-d1a7-4da7-af9e-d914478f2199 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:07:07.934837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88996f9-b46d-4e32-aec3-cec3032df5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:07:07.935464 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88996f9-b46d-4e32-aec3-cec3032df5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:07:07.935777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88996f9-b46d-4e32-aec3-cec3032df5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:07:07.936062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88996f9-b46d-4e32-aec3-cec3032df5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:07:07.944835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88996f9-b46d-4e32-aec3-cec3032df5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:07:07.946310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88996f9-b46d-4e32-aec3-cec3032df5f8 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:07:07.956862 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 742/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:07:17.865892 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=33 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:07:17.952773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=33 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:08:49.792910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b57fc2-056b-45f6-a4f3-69c965259a69 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:49.793483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b57fc2-056b-45f6-a4f3-69c965259a69 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:49.793483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b57fc2-056b-45f6-a4f3-69c965259a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:49.811291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-36b57fc2-056b-45f6-a4f3-69c965259a69 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:08:49.812501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-36b57fc2-056b-45f6-a4f3-69c965259a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:08:49.820681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 752/1494] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:08:49.828585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5af23-0434-4714-b879-1646fdb48814 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:49.829049 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5af23-0434-4714-b879-1646fdb48814 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:49.829154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5af23-0434-4714-b879-1646fdb48814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:49.847132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-6af5af23-0434-4714-b879-1646fdb48814 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:08:49.848369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6af5af23-0434-4714-b879-1646fdb48814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:08:49.856765 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 743/1495] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:08:49.861245 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b57fc2-056b-45f6-a4f3-69c965259a69 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:08:49.870988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b57fc2-056b-45f6-a4f3-69c965259a69 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:08:49.875370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5d065-6890-4d55-807e-3278ee50a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:08:49.876054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5d065-6890-4d55-807e-3278ee50a9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:49.876339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5d065-6890-4d55-807e-3278ee50a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:49.876616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5d065-6890-4d55-807e-3278ee50a9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:49.877343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5d065-6890-4d55-807e-3278ee50a9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:08:49.877650 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5d065-6890-4d55-807e-3278ee50a9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:08:49.878668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-52b5d065-6890-4d55-807e-3278ee50a9d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:08:49.878668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 02 10:08:49.878668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: Jun 02 10:08:49.879548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b5d065-6890-4d55-807e-3278ee50a9d4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:08:49.891991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 753/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:08:49.900809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5af23-0434-4714-b879-1646fdb48814 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:08:49.909789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5af23-0434-4714-b879-1646fdb48814 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:08:49.914607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbf3b1-b2d1-438c-82a3-a9dbf4935ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:08:49.915268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbf3b1-b2d1-438c-82a3-a9dbf4935ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:49.915567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbf3b1-b2d1-438c-82a3-a9dbf4935ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:49.915862 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbf3b1-b2d1-438c-82a3-a9dbf4935ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:49.916574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbf3b1-b2d1-438c-82a3-a9dbf4935ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:08:49.918320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: WARNING py.warnings [None req-6abbf3b1-b2d1-438c-82a3-a9dbf4935ff8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:08:49.918320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: warnings.warn(msg) Jun 02 10:08:49.918320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: Jun 02 10:08:49.919480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbf3b1-b2d1-438c-82a3-a9dbf4935ff8 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:08:50.045021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 744/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:08:49 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:08:50.049217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5d065-6890-4d55-807e-3278ee50a9d4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:08:50.059256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5d065-6890-4d55-807e-3278ee50a9d4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:08:50.116163 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0d608-9173-4c93-ae9c-5ab6571ae271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:08:50.117014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0d608-9173-4c93-ae9c-5ab6571ae271 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:50.117302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0d608-9173-4c93-ae9c-5ab6571ae271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:50.117587 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0d608-9173-4c93-ae9c-5ab6571ae271 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:50.118290 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0d608-9173-4c93-ae9c-5ab6571ae271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:08:50.119354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-b9f0d608-9173-4c93-ae9c-5ab6571ae271 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:08:50.119354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 02 10:08:50.119354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: Jun 02 10:08:50.120623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0d608-9173-4c93-ae9c-5ab6571ae271 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:08:50.218384 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 754/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:08:50 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:08:50.222495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbf3b1-b2d1-438c-82a3-a9dbf4935ff8 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:08:50.233464 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbf3b1-b2d1-438c-82a3-a9dbf4935ff8 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:08:50.238121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c5821-c8ea-4975-83dc-aadca947c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:08:50.238775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5821-c8ea-4975-83dc-aadca947c266 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:50.239069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5821-c8ea-4975-83dc-aadca947c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:50.239348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c5821-c8ea-4975-83dc-aadca947c266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:50.240244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c5821-c8ea-4975-83dc-aadca947c266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:08:50.242134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: WARNING py.warnings [None req-e11c5821-c8ea-4975-83dc-aadca947c266 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:08:50.242134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: warnings.warn(msg) Jun 02 10:08:50.242134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: Jun 02 10:08:50.243016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c5821-c8ea-4975-83dc-aadca947c266 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:08:50.255449 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 745/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:08:50.260034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0d608-9173-4c93-ae9c-5ab6571ae271 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:08:50.270293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0d608-9173-4c93-ae9c-5ab6571ae271 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:08:50.274954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290015-749c-47ef-87a8-2ad68cfcf737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:08:50.275635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290015-749c-47ef-87a8-2ad68cfcf737 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:50.275929 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290015-749c-47ef-87a8-2ad68cfcf737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:50.276207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290015-749c-47ef-87a8-2ad68cfcf737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:50.276938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd290015-749c-47ef-87a8-2ad68cfcf737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:08:50.277950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-bd290015-749c-47ef-87a8-2ad68cfcf737 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:08:50.277950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 02 10:08:50.277950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: Jun 02 10:08:50.278832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd290015-749c-47ef-87a8-2ad68cfcf737 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:08:50.292331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 755/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:08:50.296617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c5821-c8ea-4975-83dc-aadca947c266 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:08:50.306806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c5821-c8ea-4975-83dc-aadca947c266 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:08:50.311187 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcb611-f535-4986-8ed9-31f2693fa432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:08:50.312084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcb611-f535-4986-8ed9-31f2693fa432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:50.312368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcb611-f535-4986-8ed9-31f2693fa432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:50.312644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcb611-f535-4986-8ed9-31f2693fa432 admin admin] PATH_INFO: `/v3/projects/5e52a0e0ba0f46f89466764a2daeab9b/users/3f48986dc98249dcb43f37d099b3f4b7/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:50.327426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcb611-f535-4986-8ed9-31f2693fa432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e52a0e0ba0f46f89466764a2daeab9b, user_id=3f48986dc98249dcb43f37d099b3f4b7, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:08:50.328585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: WARNING py.warnings [None req-b7fcb611-f535-4986-8ed9-31f2693fa432 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:08:50.328585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: warnings.warn(msg) Jun 02 10:08:50.328585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: Jun 02 10:08:50.330487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fcb611-f535-4986-8ed9-31f2693fa432 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:08:50.385285 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 746/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:08:50 2022] PUT /identity/v3/projects/5e52a0e0ba0f46f89466764a2daeab9b/users/3f48986dc98249dcb43f37d099b3f4b7/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:08:50.397904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b875659-e955-4702-9220-123358d58e53 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:50.398228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b875659-e955-4702-9220-123358d58e53 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:50.398517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b875659-e955-4702-9220-123358d58e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:50.424756 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9b875659-e955-4702-9220-123358d58e53 None None] MFA Rules not processed for user `3f48986dc98249dcb43f37d099b3f4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:08:50.425979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9b875659-e955-4702-9220-123358d58e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:08:50.493847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 756/1502] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:08:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:08:50.508259 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd91def-3855-49b9-b589-a5b4bd9cf851 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:50.508554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd91def-3855-49b9-b589-a5b4bd9cf851 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:50.508840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd91def-3855-49b9-b589-a5b4bd9cf851 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:50.510274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 747/1503] 10.222.0.48 () {54 vars in 963 bytes} [Thu Jun 2 10:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:08:50.515134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578130-7ae5-4a51-b4c9-a596c7ec86de None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:50.515714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578130-7ae5-4a51-b4c9-a596c7ec86de None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:50.515998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578130-7ae5-4a51-b4c9-a596c7ec86de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:50.533828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2d578130-7ae5-4a51-b4c9-a596c7ec86de None None] MFA Rules not processed for user `0faacba133664123b4046de741073bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:08:50.535028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2d578130-7ae5-4a51-b4c9-a596c7ec86de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:08:50.584288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:08:50.592074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 757/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Thu Jun 2 10:08:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:08:50.600046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd91def-3855-49b9-b589-a5b4bd9cf851 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:08:50.611239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd91def-3855-49b9-b589-a5b4bd9cf851 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:08:50.614716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d320c-5666-421f-8f29-9a05f63d2668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:08:50.615347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d320c-5666-421f-8f29-9a05f63d2668 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:50.615662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d320c-5666-421f-8f29-9a05f63d2668 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:50.615963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d320c-5666-421f-8f29-9a05f63d2668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:50.624527 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d320c-5666-421f-8f29-9a05f63d2668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:08:50.625982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d320c-5666-421f-8f29-9a05f63d2668 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:08:50.634769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 748/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:08:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:08:50.676673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20903-1c31-4e13-b9de-e6afac30fe6e None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:50.676959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20903-1c31-4e13-b9de-e6afac30fe6e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:50.677233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d20903-1c31-4e13-b9de-e6afac30fe6e None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:50.679142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 758/1506] 10.222.0.48 () {52 vars in 829 bytes} [Thu Jun 2 10:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:08:50.682809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d320c-5666-421f-8f29-9a05f63d2668 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:08:50.743718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d320c-5666-421f-8f29-9a05f63d2668 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:08:50.748100 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:08:50.748983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:50.749262 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:50.749534 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] PATH_INFO: `/v3/users/3f48986dc98249dcb43f37d099b3f4b7` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:50.750695 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f48986dc98249dcb43f37d099b3f4b7)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:08:50.751749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: WARNING py.warnings [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:08:50.751749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: warnings.warn(msg) Jun 02 10:08:50.751749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: Jun 02 10:08:50.752935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:08:50.943025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f48986dc98249dcb43f37d099b3f4b7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:08:50.962364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f48986dc98249dcb43f37d099b3f4b7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:08:50.963153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f48986dc98249dcb43f37d099b3f4b7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:08:50.975011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f48986dc98249dcb43f37d099b3f4b7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:08:50.976645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f48986dc98249dcb43f37d099b3f4b7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:08:50.980621 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:08:51.066765 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 749/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:08:50 2022] DELETE /identity/v3/users/3f48986dc98249dcb43f37d099b3f4b7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:08:51.071223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5abe7-f245-411f-895e-c4d380886c44 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:51.071762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5abe7-f245-411f-895e-c4d380886c44 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:51.071871 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5abe7-f245-411f-895e-c4d380886c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:51.089987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-14f5abe7-f245-411f-895e-c4d380886c44 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:08:51.091268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-14f5abe7-f245-411f-895e-c4d380886c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:08:51.151380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 759/1508] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:08:51.160727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:08:51.162210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:08:51.217220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb96ae-d1c3-48fa-9040-65e2740b273c admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:08:51.220791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71255cb-0856-4640-9995-96ae3583a72b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:08:51.221430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71255cb-0856-4640-9995-96ae3583a72b service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:51.221713 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71255cb-0856-4640-9995-96ae3583a72b service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:51.221990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71255cb-0856-4640-9995-96ae3583a72b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:51.231768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71255cb-0856-4640-9995-96ae3583a72b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:08:51.233195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71255cb-0856-4640-9995-96ae3583a72b service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:08:51.242356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 750/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:08:51.679938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5abe7-f245-411f-895e-c4d380886c44 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:08:51.682126 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-14f5abe7-f245-411f-895e-c4d380886c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:08:51.695342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5abe7-f245-411f-895e-c4d380886c44 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:08:51.701317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:08:51.702164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:08:51.702447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:08:51.702826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] PATH_INFO: `/v3/projects/5e52a0e0ba0f46f89466764a2daeab9b` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:08:51.706174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e52a0e0ba0f46f89466764a2daeab9b)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:08:51.706434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:08:51.706434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 02 10:08:51.706434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: Jun 02 10:08:51.707641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:08:51.837317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e52a0e0ba0f46f89466764a2daeab9b', 'request_id': 'req-0e650d0b-4191-45e3-a78d-98e0ff19e51d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:08:51.844092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e52a0e0ba0f46f89466764a2daeab9b', 'request_id': 'req-0e650d0b-4191-45e3-a78d-98e0ff19e51d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:08:51.857299 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e52a0e0ba0f46f89466764a2daeab9b', 'request_id': 'req-0e650d0b-4191-45e3-a78d-98e0ff19e51d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:08:51.929968 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] The token cache is being invalidate because project 5e52a0e0ba0f46f89466764a2daeab9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:08:51.930273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:08:51.931010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0e650d0b-4191-45e3-a78d-98e0ff19e51d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:08:51.932658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 760/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:08:51 2022] DELETE /identity/v3/projects/5e52a0e0ba0f46f89466764a2daeab9b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:09:01.238341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:09:01.925667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:10:37.951432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf1c6d-af01-4dce-87ac-2d2fcbbabe69 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:37.952066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf1c6d-af01-4dce-87ac-2d2fcbbabe69 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:37.952066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf1c6d-af01-4dce-87ac-2d2fcbbabe69 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:37.953382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:10:37.958294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cfbbd-d1b7-4f2e-92fc-00616361b399 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:37.958764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cfbbd-d1b7-4f2e-92fc-00616361b399 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:37.958878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cfbbd-d1b7-4f2e-92fc-00616361b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:37.977158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bb3cfbbd-d1b7-4f2e-92fc-00616361b399 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:10:37.978353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bb3cfbbd-d1b7-4f2e-92fc-00616361b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:38.035928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:10:38.203084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf1c6d-af01-4dce-87ac-2d2fcbbabe69 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:10:38.204931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ffcf1c6d-af01-4dce-87ac-2d2fcbbabe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:38.281011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf1c6d-af01-4dce-87ac-2d2fcbbabe69 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:10:38.286578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ba926-57db-4505-afba-4759694966db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:10:38.287176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ba926-57db-4505-afba-4759694966db service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:38.287461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ba926-57db-4505-afba-4759694966db service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:38.287769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ba926-57db-4505-afba-4759694966db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:38.296153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ba926-57db-4505-afba-4759694966db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:10:38.297744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ba926-57db-4505-afba-4759694966db service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:10:38.308341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 752/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:10:39.202198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c888e5-1cd3-4e02-ab1e-ba2811481d6b None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:39.202754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c888e5-1cd3-4e02-ab1e-ba2811481d6b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:39.202754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c888e5-1cd3-4e02-ab1e-ba2811481d6b None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:39.204104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:10:39.209393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a67aa9-7b68-4d75-9db7-0522e8e2cc0d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:39.209819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a67aa9-7b68-4d75-9db7-0522e8e2cc0d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:39.209932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a67aa9-7b68-4d75-9db7-0522e8e2cc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:39.227739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b3a67aa9-7b68-4d75-9db7-0522e8e2cc0d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:10:39.228919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b3a67aa9-7b68-4d75-9db7-0522e8e2cc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:39.237493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:10:39.237993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6337-62fc-4b47-b59e-10ccba913035 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:39.238299 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6337-62fc-4b47-b59e-10ccba913035 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:39.238647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6337-62fc-4b47-b59e-10ccba913035 None None] PATH_INFO: `/v3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:39.239981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 763/1516] 10.222.0.57 () {54 vars in 925 bytes} [Thu Jun 2 10:10:39 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:10:39.246197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d9c73-fc39-4dda-a91a-882ecc5f67b2 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:39.246485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d9c73-fc39-4dda-a91a-882ecc5f67b2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:39.246761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d9c73-fc39-4dda-a91a-882ecc5f67b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:39.264921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-8e2d9c73-fc39-4dda-a91a-882ecc5f67b2 None None] MFA Rules not processed for user `fbdf5c7049f8499b8a25c88fbf4cb795`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:10:39.266070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8e2d9c73-fc39-4dda-a91a-882ecc5f67b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:39.327798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 754/1517] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jun 2 10:10:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:10:39.395071 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d6337-62fc-4b47-b59e-10ccba913035 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:10:39.410405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d6337-62fc-4b47-b59e-10ccba913035 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:10:39.416077 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36823e26-292a-4e3a-969d-0d5001b3bf66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:10:39.416713 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823e26-292a-4e3a-969d-0d5001b3bf66 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:39.417008 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823e26-292a-4e3a-969d-0d5001b3bf66 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:39.417306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823e26-292a-4e3a-969d-0d5001b3bf66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:39.426306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36823e26-292a-4e3a-969d-0d5001b3bf66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:10:39.427947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36823e26-292a-4e3a-969d-0d5001b3bf66 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:10:39.437234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 764/1518] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:10:43.422765 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75fc9d-d17b-4fea-97ce-566bd76311dc None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:43.423484 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75fc9d-d17b-4fea-97ce-566bd76311dc None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:43.423484 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75fc9d-d17b-4fea-97ce-566bd76311dc None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:43.425387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 755/1519] 10.222.0.48 () {54 vars in 960 bytes} [Thu Jun 2 10:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:10:43.431156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281368a8-9bae-4372-b40f-202eef4f5777 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:43.431636 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281368a8-9bae-4372-b40f-202eef4f5777 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:43.431748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281368a8-9bae-4372-b40f-202eef4f5777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:43.450165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-281368a8-9bae-4372-b40f-202eef4f5777 None None] MFA Rules not processed for user `fbdf5c7049f8499b8a25c88fbf4cb795`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:10:43.451394 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-281368a8-9bae-4372-b40f-202eef4f5777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:43.461321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 765/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Thu Jun 2 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:10:43.469001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75fc9d-d17b-4fea-97ce-566bd76311dc None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:10:43.483102 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75fc9d-d17b-4fea-97ce-566bd76311dc None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:10:43.488190 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f077f-ba3e-4562-a5cb-036eb7d39264 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdf5c7049f8499b8a25c88fbf4cb795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:10:43.488825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f077f-ba3e-4562-a5cb-036eb7d39264 service placement] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:43.489115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f077f-ba3e-4562-a5cb-036eb7d39264 service placement] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:43.489398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f077f-ba3e-4562-a5cb-036eb7d39264 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:43.497774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f077f-ba3e-4562-a5cb-036eb7d39264 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:10:43.499364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f077f-ba3e-4562-a5cb-036eb7d39264 service placement] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:10:43.509535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 756/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:10:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:10:50.720276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823c4e5-6f49-4583-b2f8-537a3959153f None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:50.720807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823c4e5-6f49-4583-b2f8-537a3959153f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:50.720807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823c4e5-6f49-4583-b2f8-537a3959153f None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:50.722827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:10:50.727801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c734989-7645-4fb7-884b-0df2dbc6fa20 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:50.728240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c734989-7645-4fb7-884b-0df2dbc6fa20 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:50.728348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c734989-7645-4fb7-884b-0df2dbc6fa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:50.746249 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7c734989-7645-4fb7-884b-0df2dbc6fa20 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:10:50.747421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7c734989-7645-4fb7-884b-0df2dbc6fa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:50.755094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:10:50.908621 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823c4e5-6f49-4583-b2f8-537a3959153f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:10:50.922932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823c4e5-6f49-4583-b2f8-537a3959153f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:10:50.928787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f8b1a-ab1c-461c-8820-b9f68729f1e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:10:50.929430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f8b1a-ab1c-461c-8820-b9f68729f1e3 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:50.929720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f8b1a-ab1c-461c-8820-b9f68729f1e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:50.929998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f8b1a-ab1c-461c-8820-b9f68729f1e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:50.938351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f8b1a-ab1c-461c-8820-b9f68729f1e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:10:50.940085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f8b1a-ab1c-461c-8820-b9f68729f1e3 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:10:50.950721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 767/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:10:51.842806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96730dc5-903e-4b88-b428-e560c4e09932 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:51.843340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96730dc5-903e-4b88-b428-e560c4e09932 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:51.843340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96730dc5-903e-4b88-b428-e560c4e09932 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:51.844770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 10:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:10:51.850272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1b89-6948-424f-90b9-6370feab3979 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:51.850682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1b89-6948-424f-90b9-6370feab3979 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:51.850843 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be1b89-6948-424f-90b9-6370feab3979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:51.869469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-41be1b89-6948-424f-90b9-6370feab3979 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:10:51.870671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-41be1b89-6948-424f-90b9-6370feab3979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:51.879842 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 10:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:10:52.030001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96730dc5-903e-4b88-b428-e560c4e09932 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:10:52.045087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96730dc5-903e-4b88-b428-e560c4e09932 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:10:52.050705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300d64-beb8-4aa3-b1d9-ec87f6e55dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:10:52.051345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300d64-beb8-4aa3-b1d9-ec87f6e55dc5 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:52.051666 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300d64-beb8-4aa3-b1d9-ec87f6e55dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:52.051954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300d64-beb8-4aa3-b1d9-ec87f6e55dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:52.059981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3300d64-beb8-4aa3-b1d9-ec87f6e55dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:10:52.061568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3300d64-beb8-4aa3-b1d9-ec87f6e55dc5 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:10:52.071328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 759/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:10:56.501393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25cd2-e0ad-42b1-92d8-d3880e7354a0 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:56.501934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25cd2-e0ad-42b1-92d8-d3880e7354a0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:56.501934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25cd2-e0ad-42b1-92d8-d3880e7354a0 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:56.504497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:10:56.509823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f95ce-923d-4e07-831a-7637c5fe4eaf None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:56.510215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f95ce-923d-4e07-831a-7637c5fe4eaf None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:56.510378 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f95ce-923d-4e07-831a-7637c5fe4eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:56.528261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-369f95ce-923d-4e07-831a-7637c5fe4eaf None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:10:56.529442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-369f95ce-923d-4e07-831a-7637c5fe4eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:56.537407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:10:56.574949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd25cd2-e0ad-42b1-92d8-d3880e7354a0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:10:56.576711 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fbd25cd2-e0ad-42b1-92d8-d3880e7354a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:56.634269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd25cd2-e0ad-42b1-92d8-d3880e7354a0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:10:56.637802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb8f02-5659-489b-9230-bd28aec00947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:10:56.638695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb8f02-5659-489b-9230-bd28aec00947 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:56.638981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb8f02-5659-489b-9230-bd28aec00947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:56.639261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb8f02-5659-489b-9230-bd28aec00947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:56.648425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb8f02-5659-489b-9230-bd28aec00947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:10:56.649865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb8f02-5659-489b-9230-bd28aec00947 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:10:56.659161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 770/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:10:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:10:58.910921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691651-8f58-466e-a761-dca5e5275881 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:58.911448 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691651-8f58-466e-a761-dca5e5275881 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:58.911559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691651-8f58-466e-a761-dca5e5275881 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:58.912919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:10:58.918361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722ec65-b579-4891-8d64-47ad7830aa9a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:58.918783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722ec65-b579-4891-8d64-47ad7830aa9a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:58.918923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722ec65-b579-4891-8d64-47ad7830aa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:58.936845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2722ec65-b579-4891-8d64-47ad7830aa9a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:10:58.938034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2722ec65-b579-4891-8d64-47ad7830aa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:10:58.945791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:10:58.981967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8691651-8f58-466e-a761-dca5e5275881 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:10:58.993082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8691651-8f58-466e-a761-dca5e5275881 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:10:58.996626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271aa7b-9bcd-4543-8bf6-a245bb7cb072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:10:58.997256 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271aa7b-9bcd-4543-8bf6-a245bb7cb072 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:10:58.997544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271aa7b-9bcd-4543-8bf6-a245bb7cb072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:10:58.997830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271aa7b-9bcd-4543-8bf6-a245bb7cb072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:10:59.007693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271aa7b-9bcd-4543-8bf6-a245bb7cb072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:10:59.009131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271aa7b-9bcd-4543-8bf6-a245bb7cb072 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:10:59.018973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 762/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:11:02.689926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d211e-20b3-4611-a249-a8bcf68e1a44 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:02.690374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d211e-20b3-4611-a249-a8bcf68e1a44 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:02.690501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d211e-20b3-4611-a249-a8bcf68e1a44 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:02.692617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:11:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:11:02.698027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4bf1-1322-40c6-9dd4-bccb0960d041 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:02.698458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4bf1-1322-40c6-9dd4-bccb0960d041 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:02.698601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d4bf1-1322-40c6-9dd4-bccb0960d041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:02.704896 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:11:02.716901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a45d4bf1-1322-40c6-9dd4-bccb0960d041 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:11:02.719455 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a45d4bf1-1322-40c6-9dd4-bccb0960d041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:02.725985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:11:02.997444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d211e-20b3-4611-a249-a8bcf68e1a44 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:11:02.999172 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f11d211e-20b3-4611-a249-a8bcf68e1a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:03.005817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=75 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:11:03.057050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d211e-20b3-4611-a249-a8bcf68e1a44 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:11:03.060598 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a6687-0d24-4064-b9b1-916e81207f95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:11:03.061237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a6687-0d24-4064-b9b1-916e81207f95 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:03.061523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a6687-0d24-4064-b9b1-916e81207f95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:03.061801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a6687-0d24-4064-b9b1-916e81207f95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:03.071193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a6687-0d24-4064-b9b1-916e81207f95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:11:03.072660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a6687-0d24-4064-b9b1-916e81207f95 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:11:03.083112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 773/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:11:05.335157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c863c4-a169-4952-8c88-f726c27a659b None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:05.335772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c863c4-a169-4952-8c88-f726c27a659b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:05.335772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c863c4-a169-4952-8c88-f726c27a659b None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:05.337159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 10:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:11:05.342239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82daa9-fbb5-4411-a754-e40bbc9f0571 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:05.342657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82daa9-fbb5-4411-a754-e40bbc9f0571 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:05.342803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82daa9-fbb5-4411-a754-e40bbc9f0571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:05.361157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1c82daa9-fbb5-4411-a754-e40bbc9f0571 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:11:05.362914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1c82daa9-fbb5-4411-a754-e40bbc9f0571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:05.370551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 10:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:11:05.641579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c863c4-a169-4952-8c88-f726c27a659b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:11:05.643782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d6c863c4-a169-4952-8c88-f726c27a659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:11:05.656342 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c863c4-a169-4952-8c88-f726c27a659b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:11:05.660462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f5a9d-fc84-4a05-84bb-cc3f20dce741 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:11:05.661089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5a9d-fc84-4a05-84bb-cc3f20dce741 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:11:05.661373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5a9d-fc84-4a05-84bb-cc3f20dce741 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:11:05.661647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5a9d-fc84-4a05-84bb-cc3f20dce741 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:11:05.670245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f5a9d-fc84-4a05-84bb-cc3f20dce741 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:11:05.671692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f5a9d-fc84-4a05-84bb-cc3f20dce741 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:11:05.680854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 765/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:11:15.356015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=28 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:11:15.676889 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=8 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:39.064139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52a0b-d31e-423c-a608-2bf44ede4687 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.064773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52a0b-d31e-423c-a608-2bf44ede4687 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.064773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f52a0b-d31e-423c-a608-2bf44ede4687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.103402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-74f52a0b-d31e-423c-a608-2bf44ede4687 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.105056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-74f52a0b-d31e-423c-a608-2bf44ede4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.119847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 775/1540] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.129817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2922c-efb5-4817-a5d7-e8760be3695a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.130424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2922c-efb5-4817-a5d7-e8760be3695a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.130424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2922c-efb5-4817-a5d7-e8760be3695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.156745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-31b2922c-efb5-4817-a5d7-e8760be3695a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.158025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-31b2922c-efb5-4817-a5d7-e8760be3695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.166086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe044eb-3e11-4e35-9f1d-5e2f6c8bd916 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.166796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe044eb-3e11-4e35-9f1d-5e2f6c8bd916 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.167345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe044eb-3e11-4e35-9f1d-5e2f6c8bd916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.175186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 766/1541] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.182564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2922c-efb5-4817-a5d7-e8760be3695a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.192906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2922c-efb5-4817-a5d7-e8760be3695a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.198414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0fe044eb-3e11-4e35-9f1d-5e2f6c8bd916 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.200056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0fe044eb-3e11-4e35-9f1d-5e2f6c8bd916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.209689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29310e-f0b0-4a3d-99ed-9731fefb2488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.210357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29310e-f0b0-4a3d-99ed-9731fefb2488 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.210643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29310e-f0b0-4a3d-99ed-9731fefb2488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.210922 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29310e-f0b0-4a3d-99ed-9731fefb2488 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.211693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29310e-f0b0-4a3d-99ed-9731fefb2488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:39.212028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29310e-f0b0-4a3d-99ed-9731fefb2488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:39.213037 dv-cinder-797608-25-smb devstack@keystone.service[80300]: WARNING py.warnings [None req-ee29310e-f0b0-4a3d-99ed-9731fefb2488 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:12:39.213037 dv-cinder-797608-25-smb devstack@keystone.service[80300]: warnings.warn(msg) Jun 02 10:12:39.213037 dv-cinder-797608-25-smb devstack@keystone.service[80300]: Jun 02 10:12:39.213927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29310e-f0b0-4a3d-99ed-9731fefb2488 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:39.224718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 776/1542] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.236202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbbc05-742f-4b2b-88d6-d855d5490a58 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.236543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbbc05-742f-4b2b-88d6-d855d5490a58 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.236768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbbc05-742f-4b2b-88d6-d855d5490a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.240592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 767/1543] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:12:39.250915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29310e-f0b0-4a3d-99ed-9731fefb2488 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.267809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29310e-f0b0-4a3d-99ed-9731fefb2488 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.289407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-dacbbc05-742f-4b2b-88d6-d855d5490a58 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.292620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b01474-bca5-456c-9f35-4644f6e4f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.292620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01474-bca5-456c-9f35-4644f6e4f482 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.292620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01474-bca5-456c-9f35-4644f6e4f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.292930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-dacbbc05-742f-4b2b-88d6-d855d5490a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.293019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01474-bca5-456c-9f35-4644f6e4f482 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.293019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b01474-bca5-456c-9f35-4644f6e4f482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:39.294030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b01474-bca5-456c-9f35-4644f6e4f482 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:39.306412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 777/1544] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.311768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbbc05-742f-4b2b-88d6-d855d5490a58 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.329039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbbc05-742f-4b2b-88d6-d855d5490a58 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.340289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc2e19-f2e8-4fa4-b8bc-6103399905c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.340981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc2e19-f2e8-4fa4-b8bc-6103399905c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.341272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc2e19-f2e8-4fa4-b8bc-6103399905c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.341558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc2e19-f2e8-4fa4-b8bc-6103399905c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.342348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc2e19-f2e8-4fa4-b8bc-6103399905c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:39.342669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc2e19-f2e8-4fa4-b8bc-6103399905c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:39.344534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc2e19-f2e8-4fa4-b8bc-6103399905c6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:39.363360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 778/1545] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:12:39.371388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc2e19-f2e8-4fa4-b8bc-6103399905c6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.383101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc2e19-f2e8-4fa4-b8bc-6103399905c6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.394220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ac663-3982-4c32-b70b-64f9366bcee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.395702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ac663-3982-4c32-b70b-64f9366bcee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.395702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ac663-3982-4c32-b70b-64f9366bcee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.395702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ac663-3982-4c32-b70b-64f9366bcee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.396253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ac663-3982-4c32-b70b-64f9366bcee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:39.397296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-569ac663-3982-4c32-b70b-64f9366bcee7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:12:39.397296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 02 10:12:39.397296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: Jun 02 10:12:39.399421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ac663-3982-4c32-b70b-64f9366bcee7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:39.431492 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 768/1546] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:12:39.435232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b01474-bca5-456c-9f35-4644f6e4f482 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.516347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b01474-bca5-456c-9f35-4644f6e4f482 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.516885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 779/1547] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:12:39.521845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b46fd-4158-4184-b248-5c03882cee96 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.521845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b46fd-4158-4184-b248-5c03882cee96 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.521845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b46fd-4158-4184-b248-5c03882cee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.568404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-cf0b46fd-4158-4184-b248-5c03882cee96 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.569645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cf0b46fd-4158-4184-b248-5c03882cee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.597589 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c2feb-a1eb-4916-ba50-e0201de0072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.598657 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c2feb-a1eb-4916-ba50-e0201de0072c admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.599168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c2feb-a1eb-4916-ba50-e0201de0072c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.599683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c2feb-a1eb-4916-ba50-e0201de0072c admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.600728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c2feb-a1eb-4916-ba50-e0201de0072c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:39.601981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: WARNING py.warnings [None req-4d5c2feb-a1eb-4916-ba50-e0201de0072c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:12:39.601981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: warnings.warn(msg) Jun 02 10:12:39.601981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: Jun 02 10:12:39.603570 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c2feb-a1eb-4916-ba50-e0201de0072c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:39.644098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 780/1548] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.644843 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b46fd-4158-4184-b248-5c03882cee96 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.656076 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b46fd-4158-4184-b248-5c03882cee96 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.660920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ff00a-8ba3-4378-a162-3c1c49282cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.670111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ff00a-8ba3-4378-a162-3c1c49282cfe admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.670111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ff00a-8ba3-4378-a162-3c1c49282cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.670111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ff00a-8ba3-4378-a162-3c1c49282cfe admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.670111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ff00a-8ba3-4378-a162-3c1c49282cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:39.670111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ff00a-8ba3-4378-a162-3c1c49282cfe admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:39.698336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 769/1549] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/users => generated 295 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:12:39.698336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df742b-b8a7-4b3c-bb64-749725a1455f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.698336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df742b-b8a7-4b3c-bb64-749725a1455f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.698336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df742b-b8a7-4b3c-bb64-749725a1455f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.716244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-08df742b-b8a7-4b3c-bb64-749725a1455f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.721730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-08df742b-b8a7-4b3c-bb64-749725a1455f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.725285 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 770/1550] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.726457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21746dd0-2431-4eb6-a03b-94cba6d609a7 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.726742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21746dd0-2431-4eb6-a03b-94cba6d609a7 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.727053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21746dd0-2431-4eb6-a03b-94cba6d609a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.744568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-21746dd0-2431-4eb6-a03b-94cba6d609a7 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.750503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-21746dd0-2431-4eb6-a03b-94cba6d609a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.753932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 771/1551] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.755106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53027b53-f0bf-4ec5-a413-21de8a515df7 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.755425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53027b53-f0bf-4ec5-a413-21de8a515df7 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.755742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53027b53-f0bf-4ec5-a413-21de8a515df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.773927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-53027b53-f0bf-4ec5-a413-21de8a515df7 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.774212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 781/1552] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:39.775431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-53027b53-f0bf-4ec5-a413-21de8a515df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.775663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2c823-2bd7-4413-b534-ced85a318696 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.779214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2c823-2bd7-4413-b534-ced85a318696 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.779214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2c823-2bd7-4413-b534-ced85a318696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.784247 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 772/1553] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.785550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0078bb-d114-4809-8769-7e08e7e819a6 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.785838 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0078bb-d114-4809-8769-7e08e7e819a6 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.786113 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0078bb-d114-4809-8769-7e08e7e819a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.797006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6bc2c823-2bd7-4413-b534-ced85a318696 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.798220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6bc2c823-2bd7-4413-b534-ced85a318696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.806558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 782/1554] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.806739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-3a0078bb-d114-4809-8769-7e08e7e819a6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.807831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c57b03-0556-40d2-8175-bfc980628c77 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.807960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-3a0078bb-d114-4809-8769-7e08e7e819a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.808141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c57b03-0556-40d2-8175-bfc980628c77 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.808400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c57b03-0556-40d2-8175-bfc980628c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.816697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 773/1555] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.818121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0078bb-d114-4809-8769-7e08e7e819a6 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.827260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0078bb-d114-4809-8769-7e08e7e819a6 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.829114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b7c57b03-0556-40d2-8175-bfc980628c77 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.829836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b7c57b03-0556-40d2-8175-bfc980628c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.832671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590aacc-f2ce-46a8-965d-8d86b2ea5b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.833324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590aacc-f2ce-46a8-965d-8d86b2ea5b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.833606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590aacc-f2ce-46a8-965d-8d86b2ea5b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.833882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590aacc-f2ce-46a8-965d-8d86b2ea5b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.834659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590aacc-f2ce-46a8-965d-8d86b2ea5b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:39.836200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590aacc-f2ce-46a8-965d-8d86b2ea5b7e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:39.837817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 783/1556] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.839075 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556ddd-c0fd-4beb-ac74-acfea43b6bdc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.839371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556ddd-c0fd-4beb-ac74-acfea43b6bdc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.839663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556ddd-c0fd-4beb-ac74-acfea43b6bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.849843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 774/1557] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:39.851860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6056ca3-0123-4c37-b164-e8a2167fea95 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.851860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6056ca3-0123-4c37-b164-e8a2167fea95 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.851860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6056ca3-0123-4c37-b164-e8a2167fea95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.859226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d0556ddd-c0fd-4beb-ac74-acfea43b6bdc None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.860423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d0556ddd-c0fd-4beb-ac74-acfea43b6bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.869531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f6056ca3-0123-4c37-b164-e8a2167fea95 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.874886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 784/1558] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.875056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f6056ca3-0123-4c37-b164-e8a2167fea95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.875169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0556ddd-c0fd-4beb-ac74-acfea43b6bdc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.882298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0556ddd-c0fd-4beb-ac74-acfea43b6bdc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.884671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 775/1559] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.886257 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41dd2b-7c9a-40ba-9e3a-faa20fa97670 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.886523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41dd2b-7c9a-40ba-9e3a-faa20fa97670 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.886798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41dd2b-7c9a-40ba-9e3a-faa20fa97670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.891338 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e85c1a-3181-470d-8de9-47ee2f3040c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.892056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85c1a-3181-470d-8de9-47ee2f3040c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.892340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85c1a-3181-470d-8de9-47ee2f3040c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.892616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85c1a-3181-470d-8de9-47ee2f3040c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.893602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e85c1a-3181-470d-8de9-47ee2f3040c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:39.895266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e85c1a-3181-470d-8de9-47ee2f3040c7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:39.904902 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-0e41dd2b-7c9a-40ba-9e3a-faa20fa97670 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.908967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 785/1560] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:39.909107 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-0e41dd2b-7c9a-40ba-9e3a-faa20fa97670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.909246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6617dd-254d-409a-8bf3-3d20f7d438de None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.909246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6617dd-254d-409a-8bf3-3d20f7d438de None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.909246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6617dd-254d-409a-8bf3-3d20f7d438de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.915302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 776/1561] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.916129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41dd2b-7c9a-40ba-9e3a-faa20fa97670 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.922646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:39.927082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41dd2b-7c9a-40ba-9e3a-faa20fa97670 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.929331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3c6617dd-254d-409a-8bf3-3d20f7d438de None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.930514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3c6617dd-254d-409a-8bf3-3d20f7d438de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.931969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f457179-bcad-4976-8fbf-e94288c33b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.932593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f457179-bcad-4976-8fbf-e94288c33b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.932874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f457179-bcad-4976-8fbf-e94288c33b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.933148 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f457179-bcad-4976-8fbf-e94288c33b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.933865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f457179-bcad-4976-8fbf-e94288c33b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:39.934174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f457179-bcad-4976-8fbf-e94288c33b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:39.935780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f457179-bcad-4976-8fbf-e94288c33b4e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:39.938732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 786/1562] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.939956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6811d0-0459-468b-b44b-2d85066f5f88 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.940244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6811d0-0459-468b-b44b-2d85066f5f88 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.940526 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6811d0-0459-468b-b44b-2d85066f5f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.948202 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 777/1563] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:39.948854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f457179-bcad-4976-8fbf-e94288c33b4e admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.959527 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f457179-bcad-4976-8fbf-e94288c33b4e admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.962876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0b6811d0-0459-468b-b44b-2d85066f5f88 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:39.973703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0b6811d0-0459-468b-b44b-2d85066f5f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:39.973847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721e9f6-4924-4400-97b0-7e59568412bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.973847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721e9f6-4924-4400-97b0-7e59568412bf admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.973847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721e9f6-4924-4400-97b0-7e59568412bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.973847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721e9f6-4924-4400-97b0-7e59568412bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.974237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721e9f6-4924-4400-97b0-7e59568412bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:39.974237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721e9f6-4924-4400-97b0-7e59568412bf admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:39.974443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 787/1564] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:39.974443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6811d0-0459-468b-b44b-2d85066f5f88 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.979953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 778/1565] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:39.980829 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721e9f6-4924-4400-97b0-7e59568412bf admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:39.982584 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6811d0-0459-468b-b44b-2d85066f5f88 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.988186 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79281c42-8f92-430a-b6cf-5f862a6ed0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.989055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79281c42-8f92-430a-b6cf-5f862a6ed0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.989336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79281c42-8f92-430a-b6cf-5f862a6ed0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.989611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79281c42-8f92-430a-b6cf-5f862a6ed0d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.990397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79281c42-8f92-430a-b6cf-5f862a6ed0d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:39.990672 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721e9f6-4924-4400-97b0-7e59568412bf admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:39.990804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79281c42-8f92-430a-b6cf-5f862a6ed0d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:39.993210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79281c42-8f92-430a-b6cf-5f862a6ed0d1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:39.996203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7ad6b-a882-4ccb-9064-dafcc4e294dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:39.996860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7ad6b-a882-4ccb-9064-dafcc4e294dd admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:39.997274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7ad6b-a882-4ccb-9064-dafcc4e294dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:39.997563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7ad6b-a882-4ccb-9064-dafcc4e294dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:39.998283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7ad6b-a882-4ccb-9064-dafcc4e294dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:39.998596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7ad6b-a882-4ccb-9064-dafcc4e294dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.000423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7ad6b-a882-4ccb-9064-dafcc4e294dd admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.006146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 788/1566] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:40.007528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79281c42-8f92-430a-b6cf-5f862a6ed0d1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.012668 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 779/1567] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:40.013505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7ad6b-a882-4ccb-9064-dafcc4e294dd admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.020710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79281c42-8f92-430a-b6cf-5f862a6ed0d1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.025687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553681ed-7314-479c-8e0c-d2e103425e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.026539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553681ed-7314-479c-8e0c-d2e103425e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.027015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553681ed-7314-479c-8e0c-d2e103425e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.027455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553681ed-7314-479c-8e0c-d2e103425e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.028386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553681ed-7314-479c-8e0c-d2e103425e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.029160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7ad6b-a882-4ccb-9064-dafcc4e294dd admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.031277 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553681ed-7314-479c-8e0c-d2e103425e43 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.034408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae8c73-0307-4f9b-b942-95865517fc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.035072 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae8c73-0307-4f9b-b942-95865517fc8a admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.035360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae8c73-0307-4f9b-b942-95865517fc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.035814 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae8c73-0307-4f9b-b942-95865517fc8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.036575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae8c73-0307-4f9b-b942-95865517fc8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:40.036890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae8c73-0307-4f9b-b942-95865517fc8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.038584 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae8c73-0307-4f9b-b942-95865517fc8a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.046925 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 789/1568] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:40.047817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553681ed-7314-479c-8e0c-d2e103425e43 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.053975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 780/1569] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:40.054959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae8c73-0307-4f9b-b942-95865517fc8a admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.061031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553681ed-7314-479c-8e0c-d2e103425e43 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.065220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae8c73-0307-4f9b-b942-95865517fc8a admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.067133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fda29-5c4c-466f-83ca-27697d4e4959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.068479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fda29-5c4c-466f-83ca-27697d4e4959 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.069004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fda29-5c4c-466f-83ca-27697d4e4959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.069521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fda29-5c4c-466f-83ca-27697d4e4959 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.069827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877081-69a9-4469-a0d2-ea9bb0cf795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.070472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877081-69a9-4469-a0d2-ea9bb0cf795a admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.070754 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877081-69a9-4469-a0d2-ea9bb0cf795a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.070949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fda29-5c4c-466f-83ca-27697d4e4959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:40.071075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877081-69a9-4469-a0d2-ea9bb0cf795a admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.071535 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fda29-5c4c-466f-83ca-27697d4e4959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.071724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01877081-69a9-4469-a0d2-ea9bb0cf795a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.073448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fda29-5c4c-466f-83ca-27697d4e4959 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.073620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01877081-69a9-4469-a0d2-ea9bb0cf795a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.086470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 790/1570] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:40.087508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fda29-5c4c-466f-83ca-27697d4e4959 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.098020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fda29-5c4c-466f-83ca-27697d4e4959 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.102677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16691d2-32a8-430c-9a0a-03aac343c373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.104706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16691d2-32a8-430c-9a0a-03aac343c373 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.104706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16691d2-32a8-430c-9a0a-03aac343c373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.104706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16691d2-32a8-430c-9a0a-03aac343c373 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.104706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16691d2-32a8-430c-9a0a-03aac343c373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:40.105110 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16691d2-32a8-430c-9a0a-03aac343c373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.106703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16691d2-32a8-430c-9a0a-03aac343c373 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.108233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:40.119232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 791/1571] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:40.120038 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16691d2-32a8-430c-9a0a-03aac343c373 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.129402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16691d2-32a8-430c-9a0a-03aac343c373 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.134199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0198c6-7301-46a6-8211-376c198a8701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.135045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0198c6-7301-46a6-8211-376c198a8701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.135333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0198c6-7301-46a6-8211-376c198a8701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.135635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0198c6-7301-46a6-8211-376c198a8701 admin admin] PATH_INFO: `/v3/projects/114a51f6b82c468bb5b9fcbc842146cd/users/0439579b269b4fdd927ce404937ba204/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.152160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0198c6-7301-46a6-8211-376c198a8701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=114a51f6b82c468bb5b9fcbc842146cd, user_id=0439579b269b4fdd927ce404937ba204, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.153140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-fd0198c6-7301-46a6-8211-376c198a8701 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:12:40.153140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 02 10:12:40.153140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: Jun 02 10:12:40.155064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0198c6-7301-46a6-8211-376c198a8701 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.159784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 781/1572] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:40.159784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877081-69a9-4469-a0d2-ea9bb0cf795a admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.216927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877081-69a9-4469-a0d2-ea9bb0cf795a admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.221596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda14ba-3eb8-42e5-8dab-059591d08415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.222273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda14ba-3eb8-42e5-8dab-059591d08415 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.222556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda14ba-3eb8-42e5-8dab-059591d08415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.222831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda14ba-3eb8-42e5-8dab-059591d08415 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.223553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda14ba-3eb8-42e5-8dab-059591d08415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.225472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda14ba-3eb8-42e5-8dab-059591d08415 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.240943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 792/1573] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:40 2022] PUT /identity/v3/projects/114a51f6b82c468bb5b9fcbc842146cd/users/0439579b269b4fdd927ce404937ba204/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:40.241655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0198c6-7301-46a6-8211-376c198a8701 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.306613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0198c6-7301-46a6-8211-376c198a8701 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.319466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff233-1316-46a3-851a-0a516022d25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.323116 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 782/1574] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:40.323240 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff233-1316-46a3-851a-0a516022d25f admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.323240 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff233-1316-46a3-851a-0a516022d25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.323240 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff233-1316-46a3-851a-0a516022d25f admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.324161 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda14ba-3eb8-42e5-8dab-059591d08415 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.327750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aff233-1316-46a3-851a-0a516022d25f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.330097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aff233-1316-46a3-851a-0a516022d25f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.400633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda14ba-3eb8-42e5-8dab-059591d08415 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.406250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e895e-c14d-4295-8d80-ef78864010ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.407002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e895e-c14d-4295-8d80-ef78864010ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.407284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e895e-c14d-4295-8d80-ef78864010ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.407561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e895e-c14d-4295-8d80-ef78864010ca admin admin] PATH_INFO: `/v3/projects/075aa34be82540aa81f4bb87d1a20ca8/users/6053784833a94093b9dce0fe720c48e4/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.414753 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 793/1575] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:40.415675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff233-1316-46a3-851a-0a516022d25f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.427314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e895e-c14d-4295-8d80-ef78864010ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=075aa34be82540aa81f4bb87d1a20ca8, user_id=6053784833a94093b9dce0fe720c48e4, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.430113 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e895e-c14d-4295-8d80-ef78864010ca admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.480638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff233-1316-46a3-851a-0a516022d25f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.485254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906617-ad32-4c71-990a-29177568da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.486007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906617-ad32-4c71-990a-29177568da47 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.486278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906617-ad32-4c71-990a-29177568da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.486563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906617-ad32-4c71-990a-29177568da47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.487268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48906617-ad32-4c71-990a-29177568da47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.489252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48906617-ad32-4c71-990a-29177568da47 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.504262 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:40.509037 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 783/1576] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:40 2022] PUT /identity/v3/projects/075aa34be82540aa81f4bb87d1a20ca8/users/6053784833a94093b9dce0fe720c48e4/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:40.512505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e895e-c14d-4295-8d80-ef78864010ca admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.572831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e895e-c14d-4295-8d80-ef78864010ca admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.578850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 794/1577] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/projects => generated 393 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:40.578850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906617-ad32-4c71-990a-29177568da47 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.579120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b814a-9332-477e-8820-9b5f32180335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.579120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b814a-9332-477e-8820-9b5f32180335 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.579317 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b814a-9332-477e-8820-9b5f32180335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.579532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b814a-9332-477e-8820-9b5f32180335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.580465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b814a-9332-477e-8820-9b5f32180335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.582857 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b814a-9332-477e-8820-9b5f32180335 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.619403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:40.638796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906617-ad32-4c71-990a-29177568da47 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.644154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7939f-be15-4cec-8aff-8aacfb4784b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.646888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7939f-be15-4cec-8aff-8aacfb4784b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.646888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7939f-be15-4cec-8aff-8aacfb4784b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.646888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7939f-be15-4cec-8aff-8aacfb4784b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.646888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7939f-be15-4cec-8aff-8aacfb4784b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.647953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7939f-be15-4cec-8aff-8aacfb4784b9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.675422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 784/1578] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:40.675422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b814a-9332-477e-8820-9b5f32180335 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.729894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 795/1579] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:40.731701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3148c-0bf1-4e3a-9a73-de989329ac14 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.732001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3148c-0bf1-4e3a-9a73-de989329ac14 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.732287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3148c-0bf1-4e3a-9a73-de989329ac14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.737183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b814a-9332-477e-8820-9b5f32180335 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.752255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-75e3148c-0bf1-4e3a-9a73-de989329ac14 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:40.753473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-75e3148c-0bf1-4e3a-9a73-de989329ac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:40.793461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8606e-cb4e-4218-82c5-3652a405ee43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.794141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8606e-cb4e-4218-82c5-3652a405ee43 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.794438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8606e-cb4e-4218-82c5-3652a405ee43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.794741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8606e-cb4e-4218-82c5-3652a405ee43 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.795453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8606e-cb4e-4218-82c5-3652a405ee43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.798254 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8606e-cb4e-4218-82c5-3652a405ee43 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.813328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 796/1580] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:40.818773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3148c-0bf1-4e3a-9a73-de989329ac14 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.823780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3148c-0bf1-4e3a-9a73-de989329ac14 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.828763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b24f76-49a4-441d-ae50-9145b54a8cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.829422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b24f76-49a4-441d-ae50-9145b54a8cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.829705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b24f76-49a4-441d-ae50-9145b54a8cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.829983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b24f76-49a4-441d-ae50-9145b54a8cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.830683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b24f76-49a4-441d-ae50-9145b54a8cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.832657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b24f76-49a4-441d-ae50-9145b54a8cf4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.877894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 785/1581] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:40.879441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8606e-cb4e-4218-82c5-3652a405ee43 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.889503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8606e-cb4e-4218-82c5-3652a405ee43 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:40.894407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f38127-b26e-4b39-bfe3-3e0a63f354a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:40.895062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f38127-b26e-4b39-bfe3-3e0a63f354a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.895346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f38127-b26e-4b39-bfe3-3e0a63f354a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.895654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f38127-b26e-4b39-bfe3-3e0a63f354a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.896337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f38127-b26e-4b39-bfe3-3e0a63f354a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:40.898258 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f38127-b26e-4b39-bfe3-3e0a63f354a0 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:40.962358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 797/1582] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:40.962358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f522fc2-4d20-441b-a33b-3a98908c4a98 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:40.962358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f522fc2-4d20-441b-a33b-3a98908c4a98 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:40.962358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f522fc2-4d20-441b-a33b-3a98908c4a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:40.988602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8f522fc2-4d20-441b-a33b-3a98908c4a98 None None] MFA Rules not processed for user `6053784833a94093b9dce0fe720c48e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:40.989235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 786/1583] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:40.989817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8f522fc2-4d20-441b-a33b-3a98908c4a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:40.990094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f38127-b26e-4b39-bfe3-3e0a63f354a0 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:40.996226 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:41.000657 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f38127-b26e-4b39-bfe3-3e0a63f354a0 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.005166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e161b8-ccfb-435d-b1e2-9c71c76e11ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.005819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e161b8-ccfb-435d-b1e2-9c71c76e11ed admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.006099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e161b8-ccfb-435d-b1e2-9c71c76e11ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.006373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e161b8-ccfb-435d-b1e2-9c71c76e11ed admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.007060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e161b8-ccfb-435d-b1e2-9c71c76e11ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.009005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e161b8-ccfb-435d-b1e2-9c71c76e11ed admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.057453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 798/1584] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:41.058284 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f522fc2-4d20-441b-a33b-3a98908c4a98 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.068447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f522fc2-4d20-441b-a33b-3a98908c4a98 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.072800 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7595c9a-ec67-4fd7-97a8-73a31225c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.073884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7595c9a-ec67-4fd7-97a8-73a31225c56f admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.073884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7595c9a-ec67-4fd7-97a8-73a31225c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.074055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7595c9a-ec67-4fd7-97a8-73a31225c56f admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.074656 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7595c9a-ec67-4fd7-97a8-73a31225c56f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.076613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7595c9a-ec67-4fd7-97a8-73a31225c56f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.111518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 787/1585] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:40 2022] POST /identity/v3/users => generated 297 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:41.112349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e161b8-ccfb-435d-b1e2-9c71c76e11ed admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.121812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e161b8-ccfb-435d-b1e2-9c71c76e11ed admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.126393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac3168-5984-49d2-8c57-a4af52160206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.127059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac3168-5984-49d2-8c57-a4af52160206 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.127335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac3168-5984-49d2-8c57-a4af52160206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.127658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac3168-5984-49d2-8c57-a4af52160206 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.128347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac3168-5984-49d2-8c57-a4af52160206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.130351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac3168-5984-49d2-8c57-a4af52160206 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.194275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 799/1586] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:41 2022] POST /identity/v3/users => generated 282 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:41.194275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7595c9a-ec67-4fd7-97a8-73a31225c56f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.213446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:41.221074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 788/1587] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:41 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:41.222437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac3168-5984-49d2-8c57-a4af52160206 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.232975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac3168-5984-49d2-8c57-a4af52160206 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.240159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef02a-b8e6-4e7e-951f-212ed8cf094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.240868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef02a-b8e6-4e7e-951f-212ed8cf094b admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.241151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef02a-b8e6-4e7e-951f-212ed8cf094b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.241428 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ef02a-b8e6-4e7e-951f-212ed8cf094b admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.242159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ef02a-b8e6-4e7e-951f-212ed8cf094b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.243802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ef02a-b8e6-4e7e-951f-212ed8cf094b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.248861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7595c9a-ec67-4fd7-97a8-73a31225c56f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.254171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 789/1588] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.254327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a8169-e6da-44cd-84f5-57384f122f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.254886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a8169-e6da-44cd-84f5-57384f122f70 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.255178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a8169-e6da-44cd-84f5-57384f122f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.255458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a8169-e6da-44cd-84f5-57384f122f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.257873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef02a-b8e6-4e7e-951f-212ed8cf094b admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.265366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a8169-e6da-44cd-84f5-57384f122f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.266797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a8169-e6da-44cd-84f5-57384f122f70 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.267517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ef02a-b8e6-4e7e-951f-212ed8cf094b admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.272329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c205c9f-1491-4165-b39c-faefd320d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.273036 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c205c9f-1491-4165-b39c-faefd320d77d admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.273327 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c205c9f-1491-4165-b39c-faefd320d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.273700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c205c9f-1491-4165-b39c-faefd320d77d admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.274429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c205c9f-1491-4165-b39c-faefd320d77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.276067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c205c9f-1491-4165-b39c-faefd320d77d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.276623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 800/1589] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:41.277426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a8169-e6da-44cd-84f5-57384f122f70 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.287267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a8169-e6da-44cd-84f5-57384f122f70 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.288254 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 790/1590] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.290241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78bfe-aa64-427f-b999-d80fa3275c02 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.290687 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78bfe-aa64-427f-b999-d80fa3275c02 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.291028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c78bfe-aa64-427f-b999-d80fa3275c02 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.292593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 791/1591] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jun 2 10:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:12:41.293230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c78bfe-aa64-427f-b999-d80fa3275c02 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.295695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37095bb8-a22f-4f2d-8bc7-e87b50b68d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.297130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37095bb8-a22f-4f2d-8bc7-e87b50b68d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.297573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37095bb8-a22f-4f2d-8bc7-e87b50b68d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.298019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37095bb8-a22f-4f2d-8bc7-e87b50b68d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.299255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37095bb8-a22f-4f2d-8bc7-e87b50b68d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.301193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37095bb8-a22f-4f2d-8bc7-e87b50b68d04 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.307267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c78bfe-aa64-427f-b999-d80fa3275c02 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.312077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886baaff-78aa-4e3a-8edb-f2e86b17b64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.312728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886baaff-78aa-4e3a-8edb-f2e86b17b64a admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.312924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 801/1592] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.313013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886baaff-78aa-4e3a-8edb-f2e86b17b64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.313288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886baaff-78aa-4e3a-8edb-f2e86b17b64a admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.314037 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886baaff-78aa-4e3a-8edb-f2e86b17b64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.315890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886baaff-78aa-4e3a-8edb-f2e86b17b64a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.316610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37095bb8-a22f-4f2d-8bc7-e87b50b68d04 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.326246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 792/1593] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.327042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886baaff-78aa-4e3a-8edb-f2e86b17b64a admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.327291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37095bb8-a22f-4f2d-8bc7-e87b50b68d04 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.332801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c4cb-adf1-40c8-8469-cd1c1b9a515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.333463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c4cb-adf1-40c8-8469-cd1c1b9a515e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.333750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c4cb-adf1-40c8-8469-cd1c1b9a515e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.334030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8c4cb-adf1-40c8-8469-cd1c1b9a515e admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.334784 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8c4cb-adf1-40c8-8469-cd1c1b9a515e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.336458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8c4cb-adf1-40c8-8469-cd1c1b9a515e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.338822 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886baaff-78aa-4e3a-8edb-f2e86b17b64a admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.345275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b0632-47e4-48b7-8158-a8b421fb0816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.345956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b0632-47e4-48b7-8158-a8b421fb0816 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.346244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b0632-47e4-48b7-8158-a8b421fb0816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.346513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b0632-47e4-48b7-8158-a8b421fb0816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.347229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b0632-47e4-48b7-8158-a8b421fb0816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.348204 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 802/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.348916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b0632-47e4-48b7-8158-a8b421fb0816 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.349126 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c4cb-adf1-40c8-8469-cd1c1b9a515e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.360063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 793/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.360522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8c4cb-adf1-40c8-8469-cd1c1b9a515e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.361017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b0632-47e4-48b7-8158-a8b421fb0816 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.365849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056f768-ae3a-4d38-8d9a-daa40aa4f295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.366512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056f768-ae3a-4d38-8d9a-daa40aa4f295 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.366800 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056f768-ae3a-4d38-8d9a-daa40aa4f295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.367082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056f768-ae3a-4d38-8d9a-daa40aa4f295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.367869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056f768-ae3a-4d38-8d9a-daa40aa4f295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.369605 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056f768-ae3a-4d38-8d9a-daa40aa4f295 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.373531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b0632-47e4-48b7-8158-a8b421fb0816 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.378501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c9801-eb4a-4249-aea6-c45302f2c431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.379160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c9801-eb4a-4249-aea6-c45302f2c431 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.379440 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c9801-eb4a-4249-aea6-c45302f2c431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.379784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c9801-eb4a-4249-aea6-c45302f2c431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.380650 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c9801-eb4a-4249-aea6-c45302f2c431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.380864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 803/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.382205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a68d64-dd26-413c-97f8-d0a5a8d37fd4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.382314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c9801-eb4a-4249-aea6-c45302f2c431 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.382495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a68d64-dd26-413c-97f8-d0a5a8d37fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.382785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a68d64-dd26-413c-97f8-d0a5a8d37fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.394647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 794/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.399471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c9801-eb4a-4249-aea6-c45302f2c431 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.403611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-50a68d64-dd26-413c-97f8-d0a5a8d37fd4 None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:41.404996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-50a68d64-dd26-413c-97f8-d0a5a8d37fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:41.407074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c9801-eb4a-4249-aea6-c45302f2c431 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.412926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43279a-bffc-47a2-986a-746554f84442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.413683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43279a-bffc-47a2-986a-746554f84442 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.413971 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43279a-bffc-47a2-986a-746554f84442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.414309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43279a-bffc-47a2-986a-746554f84442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.415332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43279a-bffc-47a2-986a-746554f84442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.417870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43279a-bffc-47a2-986a-746554f84442 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.431629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 795/1598] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.432297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43279a-bffc-47a2-986a-746554f84442 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.444185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43279a-bffc-47a2-986a-746554f84442 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.455160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31758f-836e-4a41-9f33-85af63c98171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.455873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31758f-836e-4a41-9f33-85af63c98171 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.456160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31758f-836e-4a41-9f33-85af63c98171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.456576 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31758f-836e-4a41-9f33-85af63c98171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.457345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31758f-836e-4a41-9f33-85af63c98171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.459036 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31758f-836e-4a41-9f33-85af63c98171 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.469978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 796/1599] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.470866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31758f-836e-4a41-9f33-85af63c98171 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.480444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31758f-836e-4a41-9f33-85af63c98171 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.484983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 804/1600] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jun 2 10:12:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:41.485950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a68d64-dd26-413c-97f8-d0a5a8d37fd4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.486084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e6557-aeb9-4eb7-bc31-69cd16f1657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.486779 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e6557-aeb9-4eb7-bc31-69cd16f1657e admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.487060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e6557-aeb9-4eb7-bc31-69cd16f1657e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.487340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e6557-aeb9-4eb7-bc31-69cd16f1657e admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.488100 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e6557-aeb9-4eb7-bc31-69cd16f1657e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.489895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e6557-aeb9-4eb7-bc31-69cd16f1657e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.497978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a68d64-dd26-413c-97f8-d0a5a8d37fd4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.504441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 797/1601] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.504441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e6557-aeb9-4eb7-bc31-69cd16f1657e admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.504671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61537c-1fac-47d8-ba1e-7a04c924150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.504671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61537c-1fac-47d8-ba1e-7a04c924150b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.504671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61537c-1fac-47d8-ba1e-7a04c924150b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.504671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61537c-1fac-47d8-ba1e-7a04c924150b admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.504978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61537c-1fac-47d8-ba1e-7a04c924150b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.506287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61537c-1fac-47d8-ba1e-7a04c924150b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.515199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e6557-aeb9-4eb7-bc31-69cd16f1657e admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.517798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 805/1602] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:41.518445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61537c-1fac-47d8-ba1e-7a04c924150b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.523429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d2169-e0b5-4411-a41c-894864bb0853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.524343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2169-e0b5-4411-a41c-894864bb0853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.524629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2169-e0b5-4411-a41c-894864bb0853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.524896 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d2169-e0b5-4411-a41c-894864bb0853 admin admin] PATH_INFO: `/v3/projects/9c58727e748f4ab087bac6eb671d1db9/users/9cebaa257d1b446991509fe54bad9fb7/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.530951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61537c-1fac-47d8-ba1e-7a04c924150b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.536425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba8e87-07b2-46bb-96c0-99336036bf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.537419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba8e87-07b2-46bb-96c0-99336036bf24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.537779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba8e87-07b2-46bb-96c0-99336036bf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.538070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba8e87-07b2-46bb-96c0-99336036bf24 admin admin] PATH_INFO: `/v3/projects/ab5b21f0ab724a4fb603a4dd912c6931/users/b8ee3e13db3746d69529e75537b1cb66/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.540703 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d2169-e0b5-4411-a41c-894864bb0853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c58727e748f4ab087bac6eb671d1db9, user_id=9cebaa257d1b446991509fe54bad9fb7, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.543366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d2169-e0b5-4411-a41c-894864bb0853 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.554648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba8e87-07b2-46bb-96c0-99336036bf24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5b21f0ab724a4fb603a4dd912c6931, user_id=b8ee3e13db3746d69529e75537b1cb66, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.557513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba8e87-07b2-46bb-96c0-99336036bf24 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.632865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 798/1603] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:41 2022] PUT /identity/v3/projects/9c58727e748f4ab087bac6eb671d1db9/users/9cebaa257d1b446991509fe54bad9fb7/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:41.632865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d2169-e0b5-4411-a41c-894864bb0853 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.658817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 806/1604] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:41 2022] PUT /identity/v3/projects/ab5b21f0ab724a4fb603a4dd912c6931/users/b8ee3e13db3746d69529e75537b1cb66/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:41.662484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba8e87-07b2-46bb-96c0-99336036bf24 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:41.693468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d2169-e0b5-4411-a41c-894864bb0853 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.708834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:41.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:41.722786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba8e87-07b2-46bb-96c0-99336036bf24 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:41.727332 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4cd19-f387-4cbf-859b-c0337c9097c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.728242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4cd19-f387-4cbf-859b-c0337c9097c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.728537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4cd19-f387-4cbf-859b-c0337c9097c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.728805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4cd19-f387-4cbf-859b-c0337c9097c7 admin admin] PATH_INFO: `/v3/projects/8927d95407e54fb2892aa038ce8d7525/users/378532c2b45a4b3b91857c0fc5cb8179/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.747534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4cd19-f387-4cbf-859b-c0337c9097c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8927d95407e54fb2892aa038ce8d7525, user_id=378532c2b45a4b3b91857c0fc5cb8179, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.751738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4cd19-f387-4cbf-859b-c0337c9097c7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:41.756532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcf4a3-42a5-4ea8-801a-3399b9eb30f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:41.757696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf4a3-42a5-4ea8-801a-3399b9eb30f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:41.758044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf4a3-42a5-4ea8-801a-3399b9eb30f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:41.758312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf4a3-42a5-4ea8-801a-3399b9eb30f7 admin admin] PATH_INFO: `/v3/projects/2982c466262e4dd39f95df9ba5d464a2/users/0c1aebe574104dfeb46e56e107cee5ca/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:41.774903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcf4a3-42a5-4ea8-801a-3399b9eb30f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2982c466262e4dd39f95df9ba5d464a2, user_id=0c1aebe574104dfeb46e56e107cee5ca, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:41.777580 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcf4a3-42a5-4ea8-801a-3399b9eb30f7 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:42.021773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 807/1605] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:41 2022] PUT /identity/v3/projects/8927d95407e54fb2892aa038ce8d7525/users/378532c2b45a4b3b91857c0fc5cb8179/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:42.021773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4cd19-f387-4cbf-859b-c0337c9097c7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:42.021773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4cd19-f387-4cbf-859b-c0337c9097c7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:42.021773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4c824-773a-46bd-bad3-a518925de351 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:42.022772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4c824-773a-46bd-bad3-a518925de351 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.022772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4c824-773a-46bd-bad3-a518925de351 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.022772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4c824-773a-46bd-bad3-a518925de351 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.023043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 799/1606] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:41 2022] PUT /identity/v3/projects/2982c466262e4dd39f95df9ba5d464a2/users/0c1aebe574104dfeb46e56e107cee5ca/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:42.023043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcf4a3-42a5-4ea8-801a-3399b9eb30f7 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:42.027015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4c824-773a-46bd-bad3-a518925de351 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:42.028695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4c824-773a-46bd-bad3-a518925de351 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:42.038280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 808/1607] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:42.038932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4c824-773a-46bd-bad3-a518925de351 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:42.073827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcf4a3-42a5-4ea8-801a-3399b9eb30f7 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:42.079959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92520659-9149-4ab9-867c-01683ef6b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:42.080705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520659-9149-4ab9-867c-01683ef6b1da admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.081093 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520659-9149-4ab9-867c-01683ef6b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.081378 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520659-9149-4ab9-867c-01683ef6b1da admin admin] PATH_INFO: `/v3/projects/76dcaec6421c42699e990ea2524882e4/users/e91d2ab665e54120aced02b83e8d2b94/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.098784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92520659-9149-4ab9-867c-01683ef6b1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dcaec6421c42699e990ea2524882e4, user_id=e91d2ab665e54120aced02b83e8d2b94, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:42.101964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92520659-9149-4ab9-867c-01683ef6b1da admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:42.116281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4c824-773a-46bd-bad3-a518925de351 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:42.121592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02d99a-40c5-425f-941c-ebb549329484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:42.122661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d99a-40c5-425f-941c-ebb549329484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.122955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d99a-40c5-425f-941c-ebb549329484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.123239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d99a-40c5-425f-941c-ebb549329484 admin admin] PATH_INFO: `/v3/projects/58e32be518cc42cd87453b955925c57e/users/c7704f30352a4b7b8b8ee9019d86f50a/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.136919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:42.141301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02d99a-40c5-425f-941c-ebb549329484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e32be518cc42cd87453b955925c57e, user_id=c7704f30352a4b7b8b8ee9019d86f50a, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:42.143796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02d99a-40c5-425f-941c-ebb549329484 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:42.166014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 800/1608] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:42 2022] PUT /identity/v3/projects/76dcaec6421c42699e990ea2524882e4/users/e91d2ab665e54120aced02b83e8d2b94/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:42.167560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddb7c2-6704-4862-a958-0a5140f6c48f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.168116 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddb7c2-6704-4862-a958-0a5140f6c48f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.168573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddb7c2-6704-4862-a958-0a5140f6c48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.192171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-03ddb7c2-6704-4862-a958-0a5140f6c48f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:42.198329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-03ddb7c2-6704-4862-a958-0a5140f6c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:42.249903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 809/1609] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:42 2022] PUT /identity/v3/projects/58e32be518cc42cd87453b955925c57e/users/c7704f30352a4b7b8b8ee9019d86f50a/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:42.250936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f223b-ce71-46a9-890a-8b79bd2b0920 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.251297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f223b-ce71-46a9-890a-8b79bd2b0920 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.251679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f223b-ce71-46a9-890a-8b79bd2b0920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.267061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 801/1610] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:42.268308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77cc5-bd58-4c4f-adc5-4e9e43730a6f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.268686 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77cc5-bd58-4c4f-adc5-4e9e43730a6f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.269031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77cc5-bd58-4c4f-adc5-4e9e43730a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.272960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-404f223b-ce71-46a9-890a-8b79bd2b0920 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:42.274171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-404f223b-ce71-46a9-890a-8b79bd2b0920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:42.287834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-24d77cc5-bd58-4c4f-adc5-4e9e43730a6f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:42.289203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-24d77cc5-bd58-4c4f-adc5-4e9e43730a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:42.317087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:42.337185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 810/1611] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:42.345450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575e913-c2ac-4a31-a396-ec5b61a504de None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.345450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575e913-c2ac-4a31-a396-ec5b61a504de None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.345450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575e913-c2ac-4a31-a396-ec5b61a504de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.355391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 802/1612] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:42.361032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466152-507f-4375-a3cc-0f7b59eea3c2 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.361307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466152-507f-4375-a3cc-0f7b59eea3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.361510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466152-507f-4375-a3cc-0f7b59eea3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.371796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5575e913-c2ac-4a31-a396-ec5b61a504de None None] MFA Rules not processed for user `0c1aebe574104dfeb46e56e107cee5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:42.376154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5575e913-c2ac-4a31-a396-ec5b61a504de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:42.398039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e6466152-507f-4375-a3cc-0f7b59eea3c2 None None] MFA Rules not processed for user `e91d2ab665e54120aced02b83e8d2b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:42.399537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e6466152-507f-4375-a3cc-0f7b59eea3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:42.455759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 811/1613] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:42.455759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a659c-fbe9-4483-9f64-d7a5bd87a011 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.455759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a659c-fbe9-4483-9f64-d7a5bd87a011 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.455759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a659c-fbe9-4483-9f64-d7a5bd87a011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.474053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-851a659c-fbe9-4483-9f64-d7a5bd87a011 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:42.475255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-851a659c-fbe9-4483-9f64-d7a5bd87a011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:42.475871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 803/1614] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:42.476779 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6466152-507f-4375-a3cc-0f7b59eea3c2 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:42.477955 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e6466152-507f-4375-a3cc-0f7b59eea3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:42.483010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 812/1615] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:42.484723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34b024-ce7e-48ef-9406-3f08329cc1a9 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.485007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34b024-ce7e-48ef-9406-3f08329cc1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.485289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34b024-ce7e-48ef-9406-3f08329cc1a9 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.486846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 813/1616] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jun 2 10:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:12:42.487727 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34b024-ce7e-48ef-9406-3f08329cc1a9 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:42.539893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6466152-507f-4375-a3cc-0f7b59eea3c2 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:42.543429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408aebf-fac2-4d0e-aa56-249a7647d8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:42.544101 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408aebf-fac2-4d0e-aa56-249a7647d8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.544383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408aebf-fac2-4d0e-aa56-249a7647d8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.544655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408aebf-fac2-4d0e-aa56-249a7647d8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.548905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34b024-ce7e-48ef-9406-3f08329cc1a9 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:42.552773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053fa8f-6786-4a7a-ae07-99de068d9d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:42.553418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053fa8f-6786-4a7a-ae07-99de068d9d1d service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.553707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053fa8f-6786-4a7a-ae07-99de068d9d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.553988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053fa8f-6786-4a7a-ae07-99de068d9d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.554541 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408aebf-fac2-4d0e-aa56-249a7647d8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:42.556026 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408aebf-fac2-4d0e-aa56-249a7647d8b0 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:42.563346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053fa8f-6786-4a7a-ae07-99de068d9d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:42.564816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053fa8f-6786-4a7a-ae07-99de068d9d1d service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:42.565833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 804/1617] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:42.566475 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408aebf-fac2-4d0e-aa56-249a7647d8b0 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:42.574480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408aebf-fac2-4d0e-aa56-249a7647d8b0 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:42.574846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 814/1618] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:42.575668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053fa8f-6786-4a7a-ae07-99de068d9d1d service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:42.578768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb63fcc-48d4-4275-8486-8aa995816d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:42.579416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63fcc-48d4-4275-8486-8aa995816d52 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.579736 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63fcc-48d4-4275-8486-8aa995816d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.580017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb63fcc-48d4-4275-8486-8aa995816d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.585611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053fa8f-6786-4a7a-ae07-99de068d9d1d service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:42.590171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb63fcc-48d4-4275-8486-8aa995816d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:42.590494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed745f2b-3a8f-4152-b92e-fba6c02985a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:42.591342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed745f2b-3a8f-4152-b92e-fba6c02985a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.591659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed745f2b-3a8f-4152-b92e-fba6c02985a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.591938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed745f2b-3a8f-4152-b92e-fba6c02985a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.592066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb63fcc-48d4-4275-8486-8aa995816d52 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:42.594443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed745f2b-3a8f-4152-b92e-fba6c02985a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:42.598271 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed745f2b-3a8f-4152-b92e-fba6c02985a2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:42.613319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 805/1619] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:42.614155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb63fcc-48d4-4275-8486-8aa995816d52 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:42.625407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb63fcc-48d4-4275-8486-8aa995816d52 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:42.626657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:42.632018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471e852-b2f2-476f-b448-e25dbce69575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:42.634460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e852-b2f2-476f-b448-e25dbce69575 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.634460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e852-b2f2-476f-b448-e25dbce69575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.634460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471e852-b2f2-476f-b448-e25dbce69575 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.634727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471e852-b2f2-476f-b448-e25dbce69575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:42.636848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471e852-b2f2-476f-b448-e25dbce69575 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:42.747872 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 815/1620] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:42 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:42.750359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed745f2b-3a8f-4152-b92e-fba6c02985a2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:42.780780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 806/1621] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:42 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:42.780930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c91ba-e152-452d-94ca-8340876bdf62 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.785338 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c91ba-e152-452d-94ca-8340876bdf62 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.785857 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c91ba-e152-452d-94ca-8340876bdf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:42.808735 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a66c91ba-e152-452d-94ca-8340876bdf62 None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:42.809862 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a66c91ba-e152-452d-94ca-8340876bdf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:42.816097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed745f2b-3a8f-4152-b92e-fba6c02985a2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:42.842327 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:42.902318 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 807/1622] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:12:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:42.903426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c91ba-e152-452d-94ca-8340876bdf62 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:42.927560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc334a-43b4-4582-bc36-1046fb30cf2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:42.928265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc334a-43b4-4582-bc36-1046fb30cf2c service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:42.930920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc334a-43b4-4582-bc36-1046fb30cf2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:42.931281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc334a-43b4-4582-bc36-1046fb30cf2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.001163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c91ba-e152-452d-94ca-8340876bdf62 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:43.013934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1f11e-078a-4235-b211-d4f537a6590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:43.015421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1f11e-078a-4235-b211-d4f537a6590c admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.026690 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1f11e-078a-4235-b211-d4f537a6590c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.028598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1f11e-078a-4235-b211-d4f537a6590c admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.030408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1f11e-078a-4235-b211-d4f537a6590c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.036157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1f11e-078a-4235-b211-d4f537a6590c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.079250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc334a-43b4-4582-bc36-1046fb30cf2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.081471 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc334a-43b4-4582-bc36-1046fb30cf2c service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.095404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 816/1623] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:43.096409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc334a-43b4-4582-bc36-1046fb30cf2c service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:43.106111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc334a-43b4-4582-bc36-1046fb30cf2c service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:43.115564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274e5dc-ba9d-412c-b9ae-3b6b01471d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:43.115845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274e5dc-ba9d-412c-b9ae-3b6b01471d64 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.116361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274e5dc-ba9d-412c-b9ae-3b6b01471d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.116851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274e5dc-ba9d-412c-b9ae-3b6b01471d64 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.117567 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274e5dc-ba9d-412c-b9ae-3b6b01471d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.119865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274e5dc-ba9d-412c-b9ae-3b6b01471d64 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.147246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 808/1624] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:42 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:43.147246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1f11e-078a-4235-b211-d4f537a6590c admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:43.223098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1f11e-078a-4235-b211-d4f537a6590c admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:43.234902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 817/1625] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:43 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:43.236144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274e5dc-ba9d-412c-b9ae-3b6b01471d64 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:43.248650 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67298759-5627-4714-88d2-9ad58c983739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:43.249987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67298759-5627-4714-88d2-9ad58c983739 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.250344 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67298759-5627-4714-88d2-9ad58c983739 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.250835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67298759-5627-4714-88d2-9ad58c983739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.257197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274e5dc-ba9d-412c-b9ae-3b6b01471d64 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:43.268575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71f57f-ff50-4eca-8de1-cf79f965d44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:43.269876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67298759-5627-4714-88d2-9ad58c983739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.270368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f57f-ff50-4eca-8de1-cf79f965d44f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.271136 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67298759-5627-4714-88d2-9ad58c983739 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.272249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f57f-ff50-4eca-8de1-cf79f965d44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.272723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71f57f-ff50-4eca-8de1-cf79f965d44f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.276845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71f57f-ff50-4eca-8de1-cf79f965d44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.285966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71f57f-ff50-4eca-8de1-cf79f965d44f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.287986 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 809/1626] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:43.288954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67298759-5627-4714-88d2-9ad58c983739 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:43.302720 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67298759-5627-4714-88d2-9ad58c983739 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:43.308779 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496f357-b77a-43e5-a2aa-21bbf6c5bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:43.310250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f357-b77a-43e5-a2aa-21bbf6c5bf02 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.310250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f357-b77a-43e5-a2aa-21bbf6c5bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.310504 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f357-b77a-43e5-a2aa-21bbf6c5bf02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.311943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496f357-b77a-43e5-a2aa-21bbf6c5bf02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.313947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496f357-b77a-43e5-a2aa-21bbf6c5bf02 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.316257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 818/1627] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:43.322342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71f57f-ff50-4eca-8de1-cf79f965d44f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:43.326679 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 810/1628] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:43.336649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496f357-b77a-43e5-a2aa-21bbf6c5bf02 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:43.350763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496f357-b77a-43e5-a2aa-21bbf6c5bf02 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:43.358797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fcbe8-0e71-4663-9df5-5e4101667933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:43.360057 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fcbe8-0e71-4663-9df5-5e4101667933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.360317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71f57f-ff50-4eca-8de1-cf79f965d44f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:43.360778 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fcbe8-0e71-4663-9df5-5e4101667933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.361264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fcbe8-0e71-4663-9df5-5e4101667933 admin admin] PATH_INFO: `/v3/projects/f7814aa4e5524af8b0c99df13bc56be8/users/f617b990997049ae99152ce33a0fb3c4/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.381629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fcbe8-0e71-4663-9df5-5e4101667933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7814aa4e5524af8b0c99df13bc56be8, user_id=f617b990997049ae99152ce33a0fb3c4, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.381806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd88d-a645-4ca0-98bd-dcc2287e90c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:43.382444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd88d-a645-4ca0-98bd-dcc2287e90c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.382689 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd88d-a645-4ca0-98bd-dcc2287e90c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.382976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd88d-a645-4ca0-98bd-dcc2287e90c9 admin admin] PATH_INFO: `/v3/projects/27d342ebf79640c4905d409fbbe7d2fa/users/159f9470e82148e988e8fc9a9a1e606a/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.394511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fcbe8-0e71-4663-9df5-5e4101667933 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.419773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cd88d-a645-4ca0-98bd-dcc2287e90c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d342ebf79640c4905d409fbbe7d2fa, user_id=159f9470e82148e988e8fc9a9a1e606a, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.425207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cd88d-a645-4ca0-98bd-dcc2287e90c9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.521302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 819/1629] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:43 2022] PUT /identity/v3/projects/27d342ebf79640c4905d409fbbe7d2fa/users/159f9470e82148e988e8fc9a9a1e606a/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:43.527115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 811/1630] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:43 2022] PUT /identity/v3/projects/f7814aa4e5524af8b0c99df13bc56be8/users/f617b990997049ae99152ce33a0fb3c4/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:43.531845 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fcbe8-0e71-4663-9df5-5e4101667933 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:43.532039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd88d-a645-4ca0-98bd-dcc2287e90c9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:43.551473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:43.574031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:43.663510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fcbe8-0e71-4663-9df5-5e4101667933 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:43.678748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869cbd2-3357-451a-ba2f-3c2c8ebb6ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:43.679439 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869cbd2-3357-451a-ba2f-3c2c8ebb6ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.679759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869cbd2-3357-451a-ba2f-3c2c8ebb6ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.680088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869cbd2-3357-451a-ba2f-3c2c8ebb6ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.680781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869cbd2-3357-451a-ba2f-3c2c8ebb6ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.682404 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869cbd2-3357-451a-ba2f-3c2c8ebb6ae4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.691188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd88d-a645-4ca0-98bd-dcc2287e90c9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:43.702630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b984d9-663d-4540-91de-a84903f9e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:43.704887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b984d9-663d-4540-91de-a84903f9e9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.710829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b984d9-663d-4540-91de-a84903f9e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.710829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b984d9-663d-4540-91de-a84903f9e9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.711199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 812/1631] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:12:43.714284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869cbd2-3357-451a-ba2f-3c2c8ebb6ae4 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:43.714482 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b984d9-663d-4540-91de-a84903f9e9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.716786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b984d9-663d-4540-91de-a84903f9e9f3 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.731167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869cbd2-3357-451a-ba2f-3c2c8ebb6ae4 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:43.740670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00eaa1-7fcb-4982-bb56-0e00ef53c957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:43.744166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 820/1632] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:43.744330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00eaa1-7fcb-4982-bb56-0e00ef53c957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.744330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00eaa1-7fcb-4982-bb56-0e00ef53c957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.744330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00eaa1-7fcb-4982-bb56-0e00ef53c957 admin admin] PATH_INFO: `/v3/projects/f7814aa4e5524af8b0c99df13bc56be8/users/f617b990997049ae99152ce33a0fb3c4/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.745508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b984d9-663d-4540-91de-a84903f9e9f3 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:43.750481 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00eaa1-7fcb-4982-bb56-0e00ef53c957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7814aa4e5524af8b0c99df13bc56be8, user_id=f617b990997049ae99152ce33a0fb3c4, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.755659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00eaa1-7fcb-4982-bb56-0e00ef53c957 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.763981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b984d9-663d-4540-91de-a84903f9e9f3 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:43.776418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35539889-9dd4-41ba-ad34-8dc19dfe719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:43.777329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35539889-9dd4-41ba-ad34-8dc19dfe719c admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.777619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35539889-9dd4-41ba-ad34-8dc19dfe719c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.777899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35539889-9dd4-41ba-ad34-8dc19dfe719c admin admin] PATH_INFO: `/v3/projects/27d342ebf79640c4905d409fbbe7d2fa/users/159f9470e82148e988e8fc9a9a1e606a/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.784159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 813/1633] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:43 2022] PUT /identity/v3/projects/f7814aa4e5524af8b0c99df13bc56be8/users/f617b990997049ae99152ce33a0fb3c4/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:12:43.785596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35539889-9dd4-41ba-ad34-8dc19dfe719c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d342ebf79640c4905d409fbbe7d2fa, user_id=159f9470e82148e988e8fc9a9a1e606a, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:43.788517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35539889-9dd4-41ba-ad34-8dc19dfe719c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:43.794084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d43c4-9e1b-416f-ad2f-d781edc66f71 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.794428 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d43c4-9e1b-416f-ad2f-d781edc66f71 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.802977 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d43c4-9e1b-416f-ad2f-d781edc66f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.832612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 821/1634] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:43 2022] PUT /identity/v3/projects/27d342ebf79640c4905d409fbbe7d2fa/users/159f9470e82148e988e8fc9a9a1e606a/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:43.843951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28014551-bb85-48ec-bd5c-be6720f69fd2 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:43.844257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28014551-bb85-48ec-bd5c-be6720f69fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:43.844608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28014551-bb85-48ec-bd5c-be6720f69fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:43.879715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b42d43c4-9e1b-416f-ad2f-d781edc66f71 None None] MFA Rules not processed for user `f617b990997049ae99152ce33a0fb3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:43.880131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b42d43c4-9e1b-416f-ad2f-d781edc66f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:43.917413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-28014551-bb85-48ec-bd5c-be6720f69fd2 None None] MFA Rules not processed for user `159f9470e82148e988e8fc9a9a1e606a`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:43.920242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-28014551-bb85-48ec-bd5c-be6720f69fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:44.004523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 814/1635] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:12:44.025545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d43c4-9e1b-416f-ad2f-d781edc66f71 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:44.041135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 822/1636] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:12:44.133437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d43c4-9e1b-416f-ad2f-d781edc66f71 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:44.143521 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab9afd-6b87-4fbf-ab44-95497b1d4b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:44.144480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab9afd-6b87-4fbf-ab44-95497b1d4b86 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:44.145482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab9afd-6b87-4fbf-ab44-95497b1d4b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:44.145951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab9afd-6b87-4fbf-ab44-95497b1d4b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:44.158473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab9afd-6b87-4fbf-ab44-95497b1d4b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:44.160438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab9afd-6b87-4fbf-ab44-95497b1d4b86 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:44.176745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 815/1637] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:44 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:12:44.400270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28014551-bb85-48ec-bd5c-be6720f69fd2 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:44.416288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28014551-bb85-48ec-bd5c-be6720f69fd2 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:44.432495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5f87f-b58b-4e2e-8a2b-5033cf9bab44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:44.440907 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5f87f-b58b-4e2e-8a2b-5033cf9bab44 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:44.440907 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5f87f-b58b-4e2e-8a2b-5033cf9bab44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:44.440907 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5f87f-b58b-4e2e-8a2b-5033cf9bab44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:44.455108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5f87f-b58b-4e2e-8a2b-5033cf9bab44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:44.457130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5f87f-b58b-4e2e-8a2b-5033cf9bab44 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:44.521808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 823/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:44.874285 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab9afd-6b87-4fbf-ab44-95497b1d4b86 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:44.880246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab9afd-6b87-4fbf-ab44-95497b1d4b86 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:44.883685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3b957-9e8d-4136-b211-0ffbbf99ca3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:44.884434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b957-9e8d-4136-b211-0ffbbf99ca3b service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:44.884793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b957-9e8d-4136-b211-0ffbbf99ca3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:44.885146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3b957-9e8d-4136-b211-0ffbbf99ca3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:44.921801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:45.029777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3b957-9e8d-4136-b211-0ffbbf99ca3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:45.032216 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3b957-9e8d-4136-b211-0ffbbf99ca3b service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:45.062159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 816/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:45.259607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83cbb3-9781-4632-9b64-5fae0d3c4b3f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:45.259607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83cbb3-9781-4632-9b64-5fae0d3c4b3f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:45.259607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83cbb3-9781-4632-9b64-5fae0d3c4b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:45.321124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7a83cbb3-9781-4632-9b64-5fae0d3c4b3f None None] MFA Rules not processed for user `9cebaa257d1b446991509fe54bad9fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:45.321805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7a83cbb3-9781-4632-9b64-5fae0d3c4b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:45.692727 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:45.752334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa9a98-cac8-4779-8cb4-740099cae7c1 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:45.752334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa9a98-cac8-4779-8cb4-740099cae7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:45.752334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa9a98-cac8-4779-8cb4-740099cae7c1 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:45.752334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 817/1640] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jun 2 10:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:12:45.752334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234375e3-5ae3-445f-ad5f-1c92e2d70289 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:45.752334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234375e3-5ae3-445f-ad5f-1c92e2d70289 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:45.753696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234375e3-5ae3-445f-ad5f-1c92e2d70289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:45.754665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 824/1641] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:45.754665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac443b-446c-45cd-bfe9-38b2ffc02420 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:45.754665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac443b-446c-45cd-bfe9-38b2ffc02420 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:45.754665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac443b-446c-45cd-bfe9-38b2ffc02420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:45.755509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-234375e3-5ae3-445f-ad5f-1c92e2d70289 None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:45.755509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-234375e3-5ae3-445f-ad5f-1c92e2d70289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:45.756351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6cac443b-446c-45cd-bfe9-38b2ffc02420 None None] MFA Rules not processed for user `9cebaa257d1b446991509fe54bad9fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:45.756351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6cac443b-446c-45cd-bfe9-38b2ffc02420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:45.756351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 825/1642] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:45.756351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac443b-446c-45cd-bfe9-38b2ffc02420 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:45.756906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 818/1643] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jun 2 10:12:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:45.756906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57908f0c-8f1a-4d97-9e2e-6b9d252fc928 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:45.756906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57908f0c-8f1a-4d97-9e2e-6b9d252fc928 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:45.756906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57908f0c-8f1a-4d97-9e2e-6b9d252fc928 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:45.756906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 819/1644] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jun 2 10:12:45 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 10:12:45.756906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3934bf-7763-4efd-b9f2-19150df7cf9c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:45.756906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3934bf-7763-4efd-b9f2-19150df7cf9c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:45.757414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3934bf-7763-4efd-b9f2-19150df7cf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:45.759175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-8b3934bf-7763-4efd-b9f2-19150df7cf9c None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:45.759802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8b3934bf-7763-4efd-b9f2-19150df7cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:45.777879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 820/1645] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:12:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:45.834260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3934bf-7763-4efd-b9f2-19150df7cf9c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:45.854930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3934bf-7763-4efd-b9f2-19150df7cf9c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:45.870744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12771732-84d7-4fe7-8448-4232f5f96398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:45.870744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12771732-84d7-4fe7-8448-4232f5f96398 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:45.871452 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac443b-446c-45cd-bfe9-38b2ffc02420 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:45.871536 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12771732-84d7-4fe7-8448-4232f5f96398 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:45.871536 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12771732-84d7-4fe7-8448-4232f5f96398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:45.882279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52e5a5-19c3-4a6d-a61e-cc6d75f0e307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:45.883057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52e5a5-19c3-4a6d-a61e-cc6d75f0e307 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:45.883462 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52e5a5-19c3-4a6d-a61e-cc6d75f0e307 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:45.883847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52e5a5-19c3-4a6d-a61e-cc6d75f0e307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:45.909106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52e5a5-19c3-4a6d-a61e-cc6d75f0e307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:45.910065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12771732-84d7-4fe7-8448-4232f5f96398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:45.913725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52e5a5-19c3-4a6d-a61e-cc6d75f0e307 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:45.915660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12771732-84d7-4fe7-8448-4232f5f96398 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:45.938442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 826/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:45.947892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 821/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:46.211415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52e5a5-19c3-4a6d-a61e-cc6d75f0e307 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:46.318287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52e5a5-19c3-4a6d-a61e-cc6d75f0e307 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:46.324104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:46.325431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:46.325859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:46.326277 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] PATH_INFO: `/v3/users/e91d2ab665e54120aced02b83e8d2b94` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:46.328839 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91d2ab665e54120aced02b83e8d2b94)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:46.330254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:12:46.330254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 02 10:12:46.330254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: Jun 02 10:12:46.332175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:46.635170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91d2ab665e54120aced02b83e8d2b94'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:46.739074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91d2ab665e54120aced02b83e8d2b94'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:46.746233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d916083-c665-407b-8405-771c19c6e4f0 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:46.746522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d916083-c665-407b-8405-771c19c6e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:46.746800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d916083-c665-407b-8405-771c19c6e4f0 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:46.748202 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 822/1648] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jun 2 10:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:12:46.754074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f1e34-efd2-4222-9415-88d8b3473307 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:46.754293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f1e34-efd2-4222-9415-88d8b3473307 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:46.754617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f1e34-efd2-4222-9415-88d8b3473307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:46.810817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91d2ab665e54120aced02b83e8d2b94'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:46.812545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91d2ab665e54120aced02b83e8d2b94'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:46.813705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f3ecbb14-2357-4aa6-9b7c-49b79d16ae13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91d2ab665e54120aced02b83e8d2b94'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:46.848789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b28f1e34-efd2-4222-9415-88d8b3473307 None None] MFA Rules not processed for user `d9263fa2ac534b7b9e5c6658c871da9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:46.850281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b28f1e34-efd2-4222-9415-88d8b3473307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:46.850741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 827/1649] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:12:46 2022] DELETE /identity/v3/users/e91d2ab665e54120aced02b83e8d2b94 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:46.854998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f29bd7-6fe8-48e2-a1a1-686bada07f48 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:46.855509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f29bd7-6fe8-48e2-a1a1-686bada07f48 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:46.856108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f29bd7-6fe8-48e2-a1a1-686bada07f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:46.916343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-88f29bd7-6fe8-48e2-a1a1-686bada07f48 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:46.917579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-88f29bd7-6fe8-48e2-a1a1-686bada07f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:46.956843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 823/1650] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:12:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:12:47.006821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f1e34-efd2-4222-9415-88d8b3473307 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:47.008952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b28f1e34-efd2-4222-9415-88d8b3473307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:47.058572 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f1e34-efd2-4222-9415-88d8b3473307 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:47.068963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938171f-0bfe-4b73-b404-c9c207cbf73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:47.069802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938171f-0bfe-4b73-b404-c9c207cbf73c service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:47.071060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938171f-0bfe-4b73-b404-c9c207cbf73c service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:47.071741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938171f-0bfe-4b73-b404-c9c207cbf73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:47.094325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938171f-0bfe-4b73-b404-c9c207cbf73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:47.096398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938171f-0bfe-4b73-b404-c9c207cbf73c service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:47.109863 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 824/1651] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:12:47.117396 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 828/1652] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:12:47.143925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938171f-0bfe-4b73-b404-c9c207cbf73c service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:47.156468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938171f-0bfe-4b73-b404-c9c207cbf73c service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:47.162113 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23991b3c-6687-4868-9378-f0f6f2d604d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:47.163387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23991b3c-6687-4868-9378-f0f6f2d604d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:47.164147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23991b3c-6687-4868-9378-f0f6f2d604d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:47.164802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23991b3c-6687-4868-9378-f0f6f2d604d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:47.182104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23991b3c-6687-4868-9378-f0f6f2d604d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:47.184997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23991b3c-6687-4868-9378-f0f6f2d604d3 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:47.199682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 825/1653] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:47.355168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:48.364640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c2238-6d74-483c-b989-75f6b5e0780e None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:48.365762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c2238-6d74-483c-b989-75f6b5e0780e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:48.366214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c2238-6d74-483c-b989-75f6b5e0780e None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:48.368333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 829/1654] 10.222.0.48 () {54 vars in 960 bytes} [Thu Jun 2 10:12:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:12:48.376632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ae4a-a1f5-495e-8a9f-840b0b1748df None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:48.377169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ae4a-a1f5-495e-8a9f-840b0b1748df None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:48.377239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ae4a-a1f5-495e-8a9f-840b0b1748df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:48.421474 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7772ae4a-a1f5-495e-8a9f-840b0b1748df None None] MFA Rules not processed for user `fbdf5c7049f8499b8a25c88fbf4cb795`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:48.424022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7772ae4a-a1f5-495e-8a9f-840b0b1748df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:48.429967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c2238-6d74-483c-b989-75f6b5e0780e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:48.432021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6e0c2238-6d74-483c-b989-75f6b5e0780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:48.436850 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:48.462485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c2238-6d74-483c-b989-75f6b5e0780e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:48.473547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:48.475825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:48.476123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:48.476412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] PATH_INFO: `/v3/projects/76dcaec6421c42699e990ea2524882e4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:48.479184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76dcaec6421c42699e990ea2524882e4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:48.501634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:48.604819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 826/1655] 10.222.0.48 () {58 vars in 1057 bytes} [Thu Jun 2 10:12:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:48.606020 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772ae4a-a1f5-495e-8a9f-840b0b1748df None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:48.619183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772ae4a-a1f5-495e-8a9f-840b0b1748df None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:48.646174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd768b23-e4f5-4089-a6ab-51386bea06b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdf5c7049f8499b8a25c88fbf4cb795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:48.647184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd768b23-e4f5-4089-a6ab-51386bea06b3 service placement] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:48.647653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd768b23-e4f5-4089-a6ab-51386bea06b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:48.648072 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd768b23-e4f5-4089-a6ab-51386bea06b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:48.650330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-bd768b23-e4f5-4089-a6ab-51386bea06b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:48.674371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd768b23-e4f5-4089-a6ab-51386bea06b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:48.677376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd768b23-e4f5-4089-a6ab-51386bea06b3 service placement] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:48.705589 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 827/1656] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:48.737944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76dcaec6421c42699e990ea2524882e4', 'request_id': 'req-3b5b2377-d7cf-40d5-88a8-cd344a798c61'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:48.759767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76dcaec6421c42699e990ea2524882e4', 'request_id': 'req-3b5b2377-d7cf-40d5-88a8-cd344a798c61'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:48.780238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76dcaec6421c42699e990ea2524882e4', 'request_id': 'req-3b5b2377-d7cf-40d5-88a8-cd344a798c61'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:48.914109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] The token cache is being invalidate because project 76dcaec6421c42699e990ea2524882e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:12:48.914109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:48.916908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:48.933030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 830/1657] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:12:48 2022] DELETE /identity/v3/projects/76dcaec6421c42699e990ea2524882e4 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:48.937014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd768b23-e4f5-4089-a6ab-51386bea06b3 service placement] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:48.955929 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd768b23-e4f5-4089-a6ab-51386bea06b3 service placement] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:49.109383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5228169-f631-4a9b-b397-131a3c13e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:49.110293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5228169-f631-4a9b-b397-131a3c13e9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:49.110643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5228169-f631-4a9b-b397-131a3c13e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:49.110919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5228169-f631-4a9b-b397-131a3c13e9b5 admin admin] PATH_INFO: `/v3/users/f617b990997049ae99152ce33a0fb3c4` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:49.112230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5228169-f631-4a9b-b397-131a3c13e9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f617b990997049ae99152ce33a0fb3c4)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:49.118074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5228169-f631-4a9b-b397-131a3c13e9b5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:49.392074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a5228169-f631-4a9b-b397-131a3c13e9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f617b990997049ae99152ce33a0fb3c4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:49.449899 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a5228169-f631-4a9b-b397-131a3c13e9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f617b990997049ae99152ce33a0fb3c4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:49.453676 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a5228169-f631-4a9b-b397-131a3c13e9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f617b990997049ae99152ce33a0fb3c4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:49.468930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a5228169-f631-4a9b-b397-131a3c13e9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f617b990997049ae99152ce33a0fb3c4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:49.469888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a5228169-f631-4a9b-b397-131a3c13e9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f617b990997049ae99152ce33a0fb3c4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:49.591151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 828/1658] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:12:48 2022] DELETE /identity/v3/users/f617b990997049ae99152ce33a0fb3c4 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:50.031602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:50.033123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:50.129012 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b2377-d7cf-40d5-88a8-cd344a798c61 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:50.351440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:50.352623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:50.353042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:50.353463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] PATH_INFO: `/v3/users/0c1aebe574104dfeb46e56e107cee5ca` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:50.356298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1aebe574104dfeb46e56e107cee5ca)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:50.374871 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:50.455897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:50.782726 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1aebe574104dfeb46e56e107cee5ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:50.942167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1aebe574104dfeb46e56e107cee5ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:50.959096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1aebe574104dfeb46e56e107cee5ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:50.959871 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1aebe574104dfeb46e56e107cee5ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:50.960588 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1aebe574104dfeb46e56e107cee5ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:50.978359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 831/1659] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:12:50 2022] DELETE /identity/v3/users/0c1aebe574104dfeb46e56e107cee5ca => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:50.982862 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c6c7-aa84-4edb-99c9-cd23554a2101 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:50.984067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c6c7-aa84-4edb-99c9-cd23554a2101 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:50.984501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c6c7-aa84-4edb-99c9-cd23554a2101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:51.010515 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-18e2c6c7-aa84-4edb-99c9-cd23554a2101 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:51.017812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-18e2c6c7-aa84-4edb-99c9-cd23554a2101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:51.026705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:51.189389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 829/1660] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:51.421833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:51.424173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:51.486398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2c6c7-aa84-4edb-99c9-cd23554a2101 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:51.487900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-18e2c6c7-aa84-4edb-99c9-cd23554a2101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:51.513652 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2c6c7-aa84-4edb-99c9-cd23554a2101 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:51.555050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:51.558455 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:51.558755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:51.559045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] PATH_INFO: `/v3/projects/f7814aa4e5524af8b0c99df13bc56be8` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:51.564801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7814aa4e5524af8b0c99df13bc56be8)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:51.570566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: WARNING py.warnings [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 10:12:51.570566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: warnings.warn(msg) Jun 02 10:12:51.570566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: Jun 02 10:12:51.571911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:51.627700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996983a9-5c53-4af2-b880-8d6591837e61 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:51.639668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7aef4-8f9e-454c-ad0e-9a73a15bdd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:51.640445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7aef4-8f9e-454c-ad0e-9a73a15bdd59 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:51.640858 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7aef4-8f9e-454c-ad0e-9a73a15bdd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:51.641157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7aef4-8f9e-454c-ad0e-9a73a15bdd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:51.670023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7aef4-8f9e-454c-ad0e-9a73a15bdd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:51.680835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7aef4-8f9e-454c-ad0e-9a73a15bdd59 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:51.739417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 832/1661] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:51.740572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7aef4-8f9e-454c-ad0e-9a73a15bdd59 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:51.747713 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-82c7aef4-8f9e-454c-ad0e-9a73a15bdd59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:51.787975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7aef4-8f9e-454c-ad0e-9a73a15bdd59 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:51.803539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7814aa4e5524af8b0c99df13bc56be8', 'request_id': 'req-7524aad6-3f22-4825-bfbe-1fa6b97db090'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:51.916076 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97ac2f-0976-45af-ac4f-f48b1c63d3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:51.916076 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97ac2f-0976-45af-ac4f-f48b1c63d3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:51.916076 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97ac2f-0976-45af-ac4f-f48b1c63d3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:51.916076 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97ac2f-0976-45af-ac4f-f48b1c63d3e3 admin admin] PATH_INFO: `/v3/users/6053784833a94093b9dce0fe720c48e4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:51.917512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97ac2f-0976-45af-ac4f-f48b1c63d3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6053784833a94093b9dce0fe720c48e4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:51.930901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97ac2f-0976-45af-ac4f-f48b1c63d3e3 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:51.937385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7814aa4e5524af8b0c99df13bc56be8', 'request_id': 'req-7524aad6-3f22-4825-bfbe-1fa6b97db090'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:51.966329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7814aa4e5524af8b0c99df13bc56be8', 'request_id': 'req-7524aad6-3f22-4825-bfbe-1fa6b97db090'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:51.994830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] The token cache is being invalidate because project f7814aa4e5524af8b0c99df13bc56be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:12:51.996009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:51.996944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7524aad6-3f22-4825-bfbe-1fa6b97db090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:51.999844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 830/1662] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:12:51 2022] DELETE /identity/v3/projects/f7814aa4e5524af8b0c99df13bc56be8 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:52.004492 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc436128-3481-40ec-a0c2-d91a783dd447 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.005682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc436128-3481-40ec-a0c2-d91a783dd447 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.005682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc436128-3481-40ec-a0c2-d91a783dd447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.026800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-bc436128-3481-40ec-a0c2-d91a783dd447 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:52.028492 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-bc436128-3481-40ec-a0c2-d91a783dd447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:52.039676 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 831/1663] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:52.048184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938976de-6b57-4163-8820-c693a3142e42 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.048575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938976de-6b57-4163-8820-c693a3142e42 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.048958 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938976de-6b57-4163-8820-c693a3142e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.075813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-938976de-6b57-4163-8820-c693a3142e42 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:52.077573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-938976de-6b57-4163-8820-c693a3142e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:52.090154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 832/1664] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:12:52.091623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938976de-6b57-4163-8820-c693a3142e42 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:52.106269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938976de-6b57-4163-8820-c693a3142e42 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:52.141742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381428e-ee6b-47af-af82-4447ec9260c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:52.142811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381428e-ee6b-47af-af82-4447ec9260c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.142811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381428e-ee6b-47af-af82-4447ec9260c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.143071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381428e-ee6b-47af-af82-4447ec9260c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.145915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381428e-ee6b-47af-af82-4447ec9260c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:52.146252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381428e-ee6b-47af-af82-4447ec9260c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:52.150938 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381428e-ee6b-47af-af82-4447ec9260c1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:52.156667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1a97ac2f-0976-45af-ac4f-f48b1c63d3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6053784833a94093b9dce0fe720c48e4'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:52.214364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 833/1665] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:52.225647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381428e-ee6b-47af-af82-4447ec9260c1 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:52.254713 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381428e-ee6b-47af-af82-4447ec9260c1 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:52.267363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95865e2-c769-4ac5-8f6a-9553bd62dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:52.268085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95865e2-c769-4ac5-8f6a-9553bd62dbeb admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.269369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95865e2-c769-4ac5-8f6a-9553bd62dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.269662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95865e2-c769-4ac5-8f6a-9553bd62dbeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.273279 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95865e2-c769-4ac5-8f6a-9553bd62dbeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:52.277505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1a97ac2f-0976-45af-ac4f-f48b1c63d3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6053784833a94093b9dce0fe720c48e4'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:52.288928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95865e2-c769-4ac5-8f6a-9553bd62dbeb admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:52.324783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1a97ac2f-0976-45af-ac4f-f48b1c63d3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6053784833a94093b9dce0fe720c48e4'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:52.326072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1a97ac2f-0976-45af-ac4f-f48b1c63d3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6053784833a94093b9dce0fe720c48e4'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:52.328649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1a97ac2f-0976-45af-ac4f-f48b1c63d3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6053784833a94093b9dce0fe720c48e4'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:52.415378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 833/1666] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:12:51 2022] DELETE /identity/v3/users/6053784833a94093b9dce0fe720c48e4 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:52.420749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d92c-1dc1-469f-8fd7-2e82cd89b9b9 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.421487 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d92c-1dc1-469f-8fd7-2e82cd89b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.421921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d92c-1dc1-469f-8fd7-2e82cd89b9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.445721 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 834/1667] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:52 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:52.449742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95865e2-c769-4ac5-8f6a-9553bd62dbeb admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:52.453347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f95865e2-c769-4ac5-8f6a-9553bd62dbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:52.488208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-dd16d92c-1dc1-469f-8fd7-2e82cd89b9b9 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:52.489511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-dd16d92c-1dc1-469f-8fd7-2e82cd89b9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:52.622275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:52.642720 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95865e2-c769-4ac5-8f6a-9553bd62dbeb admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:52.661921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04775d0-c042-45d8-9bd6-73978ead3099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:52.662628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04775d0-c042-45d8-9bd6-73978ead3099 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.663952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04775d0-c042-45d8-9bd6-73978ead3099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.665180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04775d0-c042-45d8-9bd6-73978ead3099 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.665180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04775d0-c042-45d8-9bd6-73978ead3099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:52.671241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04775d0-c042-45d8-9bd6-73978ead3099 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:52.743455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 834/1668] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:52.804518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 835/1669] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:52 2022] POST /identity/v3/users => generated 284 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:12:52.808345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16d92c-1dc1-469f-8fd7-2e82cd89b9b9 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:52.819702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16d92c-1dc1-469f-8fd7-2e82cd89b9b9 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:52.836501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04775d0-c042-45d8-9bd6-73978ead3099 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:52.838802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d04775d0-c042-45d8-9bd6-73978ead3099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:52.848672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d416d-7029-4642-96dd-05a2ee9f2fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:52.849439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d416d-7029-4642-96dd-05a2ee9f2fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.849738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d416d-7029-4642-96dd-05a2ee9f2fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.850025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d416d-7029-4642-96dd-05a2ee9f2fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.860692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d416d-7029-4642-96dd-05a2ee9f2fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:52.860692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d416d-7029-4642-96dd-05a2ee9f2fa2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:52.896336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 835/1670] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:52.904815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d416d-7029-4642-96dd-05a2ee9f2fa2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:52.944874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d416d-7029-4642-96dd-05a2ee9f2fa2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:52.961097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c533e-c212-4532-bade-f73d3ae534d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:52.962058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c533e-c212-4532-bade-f73d3ae534d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:52.962494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c533e-c212-4532-bade-f73d3ae534d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:52.962918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c533e-c212-4532-bade-f73d3ae534d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:52.964060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c533e-c212-4532-bade-f73d3ae534d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:52.966057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c533e-c212-4532-bade-f73d3ae534d9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:52.984199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 836/1671] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:52.986494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c533e-c212-4532-bade-f73d3ae534d9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:52.989131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ac8c533e-c212-4532-bade-f73d3ae534d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.004317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c533e-c212-4532-bade-f73d3ae534d9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.018462 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.019456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.019771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.020059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] PATH_INFO: `/v3/projects/2982c466262e4dd39f95df9ba5d464a2` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.021368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2982c466262e4dd39f95df9ba5d464a2)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.023329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.031237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:53.039414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04775d0-c042-45d8-9bd6-73978ead3099 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.043482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0f94-c3f4-40ab-a5bd-9842ff315bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.044485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0f94-c3f4-40ab-a5bd-9842ff315bde service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.044880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0f94-c3f4-40ab-a5bd-9842ff315bde service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.045334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0f94-c3f4-40ab-a5bd-9842ff315bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.065942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0f94-c3f4-40ab-a5bd-9842ff315bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.068308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0f94-c3f4-40ab-a5bd-9842ff315bde service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.081489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 836/1672] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:53.082781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0f94-c3f4-40ab-a5bd-9842ff315bde service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.095523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0f94-c3f4-40ab-a5bd-9842ff315bde service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.101050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4729dd-0d78-401e-bb71-f6fff8c66b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.102937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4729dd-0d78-401e-bb71-f6fff8c66b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.103467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4729dd-0d78-401e-bb71-f6fff8c66b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.104021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4729dd-0d78-401e-bb71-f6fff8c66b40 admin admin] PATH_INFO: `/v3/projects/8d384f5d23fe44fab814de979c385cd6/users/ceff6224d4d14f3a8e1a661e1ddd7bc9/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.136985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4729dd-0d78-401e-bb71-f6fff8c66b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d384f5d23fe44fab814de979c385cd6, user_id=ceff6224d4d14f3a8e1a661e1ddd7bc9, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.140963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4729dd-0d78-401e-bb71-f6fff8c66b40 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.292441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 837/1673] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:53 2022] PUT /identity/v3/projects/8d384f5d23fe44fab814de979c385cd6/users/ceff6224d4d14f3a8e1a661e1ddd7bc9/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:53.304612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c60eb-fe21-4013-b57b-fe202c73c21c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.304904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c60eb-fe21-4013-b57b-fe202c73c21c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.305922 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c60eb-fe21-4013-b57b-fe202c73c21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.321161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2982c466262e4dd39f95df9ba5d464a2', 'request_id': 'req-b4e128d8-b609-48cf-b17f-ab9636cddf14'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:53.345941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2982c466262e4dd39f95df9ba5d464a2', 'request_id': 'req-b4e128d8-b609-48cf-b17f-ab9636cddf14'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:53.364849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2982c466262e4dd39f95df9ba5d464a2', 'request_id': 'req-b4e128d8-b609-48cf-b17f-ab9636cddf14'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:53.384329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-829c60eb-fe21-4013-b57b-fe202c73c21c None None] MFA Rules not processed for user `ceff6224d4d14f3a8e1a661e1ddd7bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:53.388088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-829c60eb-fe21-4013-b57b-fe202c73c21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.527112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] The token cache is being invalidate because project 2982c466262e4dd39f95df9ba5d464a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:12:53.528035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:53.529271 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:53.530917 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 838/1674] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:12:53.531549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 837/1675] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:12:52 2022] DELETE /identity/v3/projects/2982c466262e4dd39f95df9ba5d464a2 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:53.535416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c60eb-fe21-4013-b57b-fe202c73c21c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.537459 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:53.539801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:53.688941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c60eb-fe21-4013-b57b-fe202c73c21c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.689655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e128d8-b609-48cf-b17f-ab9636cddf14 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:53.698506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f16ea-afbf-4baf-8086-e925b55cdf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.700468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:53.700986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f16ea-afbf-4baf-8086-e925b55cdf15 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.702071 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f16ea-afbf-4baf-8086-e925b55cdf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.703219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f16ea-afbf-4baf-8086-e925b55cdf15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.704179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:53.704674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f16ea-afbf-4baf-8086-e925b55cdf15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.705100 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:53.706145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] PATH_INFO: `/v3/users/159f9470e82148e988e8fc9a9a1e606a` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:53.709182 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=159f9470e82148e988e8fc9a9a1e606a)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:53.712603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f16ea-afbf-4baf-8086-e925b55cdf15 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.714651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:53.831561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 838/1676] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/projects => generated 367 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:53.835900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f16ea-afbf-4baf-8086-e925b55cdf15 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.003053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159f9470e82148e988e8fc9a9a1e606a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:54.029440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f16ea-afbf-4baf-8086-e925b55cdf15 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.058514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7c5e0-755e-478f-8c61-d87e8ca43123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.059052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159f9470e82148e988e8fc9a9a1e606a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:54.060250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c5e0-755e-478f-8c61-d87e8ca43123 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.061398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159f9470e82148e988e8fc9a9a1e606a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:54.062031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c5e0-755e-478f-8c61-d87e8ca43123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.067247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7c5e0-755e-478f-8c61-d87e8ca43123 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.072910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7c5e0-755e-478f-8c61-d87e8ca43123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.077423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7c5e0-755e-478f-8c61-d87e8ca43123 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.090663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159f9470e82148e988e8fc9a9a1e606a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:54.092789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159f9470e82148e988e8fc9a9a1e606a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:54.211408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 839/1677] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:12:53 2022] DELETE /identity/v3/users/159f9470e82148e988e8fc9a9a1e606a => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:54.212403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 839/1678] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:53 2022] POST /identity/v3/users => generated 290 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:12:54.220240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.223119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:54.364535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a4eac-6ea6-4990-88a0-430bf715e451 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.369776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5045a-f4be-4cf7-96cd-d586afc3382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.370502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5045a-f4be-4cf7-96cd-d586afc3382c admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.370790 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5045a-f4be-4cf7-96cd-d586afc3382c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.371065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5045a-f4be-4cf7-96cd-d586afc3382c admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.371888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5045a-f4be-4cf7-96cd-d586afc3382c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.373930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5045a-f4be-4cf7-96cd-d586afc3382c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.386753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 840/1679] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:54.392547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7c5e0-755e-478f-8c61-d87e8ca43123 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.404053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7c5e0-755e-478f-8c61-d87e8ca43123 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.415085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744f7a0-ec69-44c5-ba6e-86abc2949452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.416260 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744f7a0-ec69-44c5-ba6e-86abc2949452 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.416858 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744f7a0-ec69-44c5-ba6e-86abc2949452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.417444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744f7a0-ec69-44c5-ba6e-86abc2949452 admin admin] PATH_INFO: `/v3/projects/511f97c3ae9e42efbe26e2a349292a17/users/92027b6a308a4b7daa9942ab88389bb2/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.438052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90b375-04ad-454d-ada0-508e044a8eb7 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.438439 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90b375-04ad-454d-ada0-508e044a8eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.438789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90b375-04ad-454d-ada0-508e044a8eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.451866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744f7a0-ec69-44c5-ba6e-86abc2949452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511f97c3ae9e42efbe26e2a349292a17, user_id=92027b6a308a4b7daa9942ab88389bb2, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.456293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744f7a0-ec69-44c5-ba6e-86abc2949452 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.479935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-eb90b375-04ad-454d-ada0-508e044a8eb7 None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:54.479935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-eb90b375-04ad-454d-ada0-508e044a8eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:54.546877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 840/1680] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:54 2022] PUT /identity/v3/projects/511f97c3ae9e42efbe26e2a349292a17/users/92027b6a308a4b7daa9942ab88389bb2/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:54.550183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744f7a0-ec69-44c5-ba6e-86abc2949452 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.635194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 841/1681] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:12:54.677400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744f7a0-ec69-44c5-ba6e-86abc2949452 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.684527 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a96dd-4c9b-4841-a6a8-e99f652fa3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.686969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a96dd-4c9b-4841-a6a8-e99f652fa3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.687447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a96dd-4c9b-4841-a6a8-e99f652fa3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.687928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a96dd-4c9b-4841-a6a8-e99f652fa3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.691761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a96dd-4c9b-4841-a6a8-e99f652fa3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.693630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a96dd-4c9b-4841-a6a8-e99f652fa3e5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.712455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 841/1682] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:54.714624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90b375-04ad-454d-ada0-508e044a8eb7 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.720792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:54.735227 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90b375-04ad-454d-ada0-508e044a8eb7 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:54.750704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d4e77-6614-403a-97fd-1385f6f41ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:54.751660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d4e77-6614-403a-97fd-1385f6f41ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.753185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d4e77-6614-403a-97fd-1385f6f41ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.753481 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d4e77-6614-403a-97fd-1385f6f41ea2 admin admin] PATH_INFO: `/v3/projects/511f97c3ae9e42efbe26e2a349292a17/users/92027b6a308a4b7daa9942ab88389bb2/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.763994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d4e77-6614-403a-97fd-1385f6f41ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511f97c3ae9e42efbe26e2a349292a17, user_id=92027b6a308a4b7daa9942ab88389bb2, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:54.768816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d4e77-6614-403a-97fd-1385f6f41ea2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:54.796419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 842/1683] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:54 2022] PUT /identity/v3/projects/511f97c3ae9e42efbe26e2a349292a17/users/92027b6a308a4b7daa9942ab88389bb2/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:54.806393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971703-36a6-4e31-9e7b-13ac6de3d5ed None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:54.806760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971703-36a6-4e31-9e7b-13ac6de3d5ed None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:54.807149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71971703-36a6-4e31-9e7b-13ac6de3d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:54.816098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d4e77-6614-403a-97fd-1385f6f41ea2 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.817846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-023d4e77-6614-403a-97fd-1385f6f41ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:54.846650 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-71971703-36a6-4e31-9e7b-13ac6de3d5ed None None] MFA Rules not processed for user `92027b6a308a4b7daa9942ab88389bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:54.848281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-71971703-36a6-4e31-9e7b-13ac6de3d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:54.940328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:54.978028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 842/1684] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:54.985331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71971703-36a6-4e31-9e7b-13ac6de3d5ed None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:54.997784 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-71971703-36a6-4e31-9e7b-13ac6de3d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:54.998485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d4e77-6614-403a-97fd-1385f6f41ea2 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.026122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.027260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.027757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.028395 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] PATH_INFO: `/v3/projects/075aa34be82540aa81f4bb87d1a20ca8` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.031394 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] RBAC: Authorizing `identity:delete_project(project_id=075aa34be82540aa81f4bb87d1a20ca8)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.038819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.161224 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71971703-36a6-4e31-9e7b-13ac6de3d5ed None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.176485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4569708-eeab-4d1b-a5b1-7a20250d4353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.177196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4569708-eeab-4d1b-a5b1-7a20250d4353 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.177472 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4569708-eeab-4d1b-a5b1-7a20250d4353 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.177753 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4569708-eeab-4d1b-a5b1-7a20250d4353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.196888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4569708-eeab-4d1b-a5b1-7a20250d4353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.198373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4569708-eeab-4d1b-a5b1-7a20250d4353 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.222144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 843/1685] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:12:55.223150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4569708-eeab-4d1b-a5b1-7a20250d4353 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.225093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c4569708-eeab-4d1b-a5b1-7a20250d4353 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:55.276089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075aa34be82540aa81f4bb87d1a20ca8', 'request_id': 'req-d70037a0-caf4-4522-8c0f-faf20a26864d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:55.381970 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075aa34be82540aa81f4bb87d1a20ca8', 'request_id': 'req-d70037a0-caf4-4522-8c0f-faf20a26864d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:55.391908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075aa34be82540aa81f4bb87d1a20ca8', 'request_id': 'req-d70037a0-caf4-4522-8c0f-faf20a26864d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:55.395229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4569708-eeab-4d1b-a5b1-7a20250d4353 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.420980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] The token cache is being invalidate because project 075aa34be82540aa81f4bb87d1a20ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:12:55.424110 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:55.425533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d70037a0-caf4-4522-8c0f-faf20a26864d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:55.430849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 843/1686] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:12:54 2022] DELETE /identity/v3/projects/075aa34be82540aa81f4bb87d1a20ca8 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:55.437751 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c6afd-7d8e-4dd6-b0c5-fa0c7463f377 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.438054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c6afd-7d8e-4dd6-b0c5-fa0c7463f377 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.438321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c6afd-7d8e-4dd6-b0c5-fa0c7463f377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.497521 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-9b6c6afd-7d8e-4dd6-b0c5-fa0c7463f377 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:55.502086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9b6c6afd-7d8e-4dd6-b0c5-fa0c7463f377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:55.537780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab12f9-e0e3-4d3d-b9b9-d1d3710c3b7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.538486 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab12f9-e0e3-4d3d-b9b9-d1d3710c3b7f service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.538751 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab12f9-e0e3-4d3d-b9b9-d1d3710c3b7f service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.539031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab12f9-e0e3-4d3d-b9b9-d1d3710c3b7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.541577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-10ab12f9-e0e3-4d3d-b9b9-d1d3710c3b7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:55.665294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab12f9-e0e3-4d3d-b9b9-d1d3710c3b7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.667732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab12f9-e0e3-4d3d-b9b9-d1d3710c3b7f service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.680026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 844/1687] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:12:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:12:55.726132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 844/1688] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:55.727573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9ec88-43e6-403d-9fc0-467843797332 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.727985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9ec88-43e6-403d-9fc0-467843797332 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.728373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9ec88-43e6-403d-9fc0-467843797332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.761882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-01d9ec88-43e6-403d-9fc0-467843797332 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:55.765467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-01d9ec88-43e6-403d-9fc0-467843797332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:55.791646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 845/1689] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:12:55.796234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c6afd-7d8e-4dd6-b0c5-fa0c7463f377 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.822279 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c6afd-7d8e-4dd6-b0c5-fa0c7463f377 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.835818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424182b-8d01-49a2-b933-d6ea8cdd5c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.836513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424182b-8d01-49a2-b933-d6ea8cdd5c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.836863 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424182b-8d01-49a2-b933-d6ea8cdd5c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.839344 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424182b-8d01-49a2-b933-d6ea8cdd5c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.840788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424182b-8d01-49a2-b933-d6ea8cdd5c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:55.841119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424182b-8d01-49a2-b933-d6ea8cdd5c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.848566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424182b-8d01-49a2-b933-d6ea8cdd5c75 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:55.897229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 845/1690] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:55.901800 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9ec88-43e6-403d-9fc0-467843797332 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:55.918257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9ec88-43e6-403d-9fc0-467843797332 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:55.928571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:55.934557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3be7f-db2e-4c9b-a953-68bf39f18a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:55.936406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3be7f-db2e-4c9b-a953-68bf39f18a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:55.936523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3be7f-db2e-4c9b-a953-68bf39f18a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:55.936787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3be7f-db2e-4c9b-a953-68bf39f18a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:55.937532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3be7f-db2e-4c9b-a953-68bf39f18a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:55.940497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af3be7f-db2e-4c9b-a953-68bf39f18a8f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.076071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424182b-8d01-49a2-b933-d6ea8cdd5c75 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.083976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 846/1691] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:55 2022] POST /identity/v3/projects => generated 353 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:56.099023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424182b-8d01-49a2-b933-d6ea8cdd5c75 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.165354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:56.347529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec0dc-e1ea-4bf8-a464-0bd0b4985da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.349138 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec0dc-e1ea-4bf8-a464-0bd0b4985da3 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.349453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec0dc-e1ea-4bf8-a464-0bd0b4985da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.349746 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec0dc-e1ea-4bf8-a464-0bd0b4985da3 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.350630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec0dc-e1ea-4bf8-a464-0bd0b4985da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.352868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec0dc-e1ea-4bf8-a464-0bd0b4985da3 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.461828 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 846/1692] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:56 2022] POST /identity/v3/users => generated 277 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:56.466234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3be7f-db2e-4c9b-a953-68bf39f18a8f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.485680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3be7f-db2e-4c9b-a953-68bf39f18a8f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.503237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d5ed4-2de2-476b-81d9-ff960f475e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.504133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d5ed4-2de2-476b-81d9-ff960f475e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.504521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d5ed4-2de2-476b-81d9-ff960f475e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.504918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d5ed4-2de2-476b-81d9-ff960f475e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.505769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d5ed4-2de2-476b-81d9-ff960f475e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.507496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d5ed4-2de2-476b-81d9-ff960f475e4d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.538449 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 847/1693] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:56.543421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec0dc-e1ea-4bf8-a464-0bd0b4985da3 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.564220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec0dc-e1ea-4bf8-a464-0bd0b4985da3 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.590747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e486b-c80c-4ffb-9a5a-fc39c2b86045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.591451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e486b-c80c-4ffb-9a5a-fc39c2b86045 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.595840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e486b-c80c-4ffb-9a5a-fc39c2b86045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.596182 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e486b-c80c-4ffb-9a5a-fc39c2b86045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.596965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e486b-c80c-4ffb-9a5a-fc39c2b86045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.598622 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e486b-c80c-4ffb-9a5a-fc39c2b86045 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:56.626255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 847/1694] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:56.630557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d5ed4-2de2-476b-81d9-ff960f475e4d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:56.666849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d5ed4-2de2-476b-81d9-ff960f475e4d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:56.712050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059bbe3-8118-453b-a01a-ba392a332a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:56.712980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059bbe3-8118-453b-a01a-ba392a332a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:56.713263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059bbe3-8118-453b-a01a-ba392a332a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:56.713540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059bbe3-8118-453b-a01a-ba392a332a43 admin admin] PATH_INFO: `/v3/projects/7cf5831dfab64027b4d34ad6ed277130/users/569d9ab821094b90900adedb6dd62a0f/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:56.773917 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:56.823899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059bbe3-8118-453b-a01a-ba392a332a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf5831dfab64027b4d34ad6ed277130, user_id=569d9ab821094b90900adedb6dd62a0f, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:56.823899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059bbe3-8118-453b-a01a-ba392a332a43 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:57.059952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3695-0c67-4d1a-9c98-0c64ff1d782b None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.059952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3695-0c67-4d1a-9c98-0c64ff1d782b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.059952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3695-0c67-4d1a-9c98-0c64ff1d782b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.168559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-57db3695-0c67-4d1a-9c98-0c64ff1d782b None None] MFA Rules not processed for user `0439579b269b4fdd927ce404937ba204`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:57.172012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-57db3695-0c67-4d1a-9c98-0c64ff1d782b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:57.348611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 848/1695] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:56 2022] PUT /identity/v3/projects/7cf5831dfab64027b4d34ad6ed277130/users/569d9ab821094b90900adedb6dd62a0f/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:12:57.350329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd047-d084-4b2d-ada1-046c81a7250f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.350623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd047-d084-4b2d-ada1-046c81a7250f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.350904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd047-d084-4b2d-ada1-046c81a7250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.417205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:57.502405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 848/1696] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:12:57.504169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1117f3c-f825-460f-a1fb-224ab0d45793 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:57.511162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1117f3c-f825-460f-a1fb-224ab0d45793 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:57.511285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-523bd047-d084-4b2d-ada1-046c81a7250f None None] MFA Rules not processed for user `378532c2b45a4b3b91857c0fc5cb8179`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:57.517934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1117f3c-f825-460f-a1fb-224ab0d45793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:57.528964 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-523bd047-d084-4b2d-ada1-046c81a7250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:57.651747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c1117f3c-f825-460f-a1fb-224ab0d45793 None None] MFA Rules not processed for user `569d9ab821094b90900adedb6dd62a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:57.654684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c1117f3c-f825-460f-a1fb-224ab0d45793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:57.852100 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:57.875344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 849/1697] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:57.875344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bd047-d084-4b2d-ada1-046c81a7250f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:57.875344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-523bd047-d084-4b2d-ada1-046c81a7250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:58.005582 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 849/1698] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:58.007096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a916435-8d02-4275-9add-54749be5bfb3 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.007386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a916435-8d02-4275-9add-54749be5bfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.007695 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a916435-8d02-4275-9add-54749be5bfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.075354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-1a916435-8d02-4275-9add-54749be5bfb3 None None] MFA Rules not processed for user `378532c2b45a4b3b91857c0fc5cb8179`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:58.081097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1a916435-8d02-4275-9add-54749be5bfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:58.128394 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 850/1699] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:58.129346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a916435-8d02-4275-9add-54749be5bfb3 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:58.177791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bd047-d084-4b2d-ada1-046c81a7250f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:58.197660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e541c40-660c-4d96-9e39-515f718614f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:58.206388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541c40-660c-4d96-9e39-515f718614f2 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.206388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541c40-660c-4d96-9e39-515f718614f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.206388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e541c40-660c-4d96-9e39-515f718614f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.416876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a916435-8d02-4275-9add-54749be5bfb3 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:58.434388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb160c-2617-4c94-85f1-e90378b4ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:58.436696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb160c-2617-4c94-85f1-e90378b4ffe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.437129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb160c-2617-4c94-85f1-e90378b4ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.441362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb160c-2617-4c94-85f1-e90378b4ffe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.442309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb160c-2617-4c94-85f1-e90378b4ffe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:58.456371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb160c-2617-4c94-85f1-e90378b4ffe7 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:58.457541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e541c40-660c-4d96-9e39-515f718614f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:58.459527 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e541c40-660c-4d96-9e39-515f718614f2 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:58.516359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 850/1700] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:58.517332 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e541c40-660c-4d96-9e39-515f718614f2 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:58.523353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6e541c40-660c-4d96-9e39-515f718614f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:58.578653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e541c40-660c-4d96-9e39-515f718614f2 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:58.612739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 851/1701] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:58 2022] POST /identity/v3/projects => generated 357 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:58.614019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ccd69-1f36-4a1a-bfdf-4751666c6b1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:58.615098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb160c-2617-4c94-85f1-e90378b4ffe7 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:58.618136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ccd69-1f36-4a1a-bfdf-4751666c6b1b service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:58.619818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ccd69-1f36-4a1a-bfdf-4751666c6b1b service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:58.621677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-31bb160c-2617-4c94-85f1-e90378b4ffe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:58.624737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ccd69-1f36-4a1a-bfdf-4751666c6b1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:58.692671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:58.695573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ccd69-1f36-4a1a-bfdf-4751666c6b1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:58.712995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ccd69-1f36-4a1a-bfdf-4751666c6b1b service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:58.767236 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 851/1702] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:12:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:12:58.768374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ccd69-1f36-4a1a-bfdf-4751666c6b1b service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:58.844567 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ccd69-1f36-4a1a-bfdf-4751666c6b1b service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:58.995482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb160c-2617-4c94-85f1-e90378b4ffe7 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:59.013382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:59.014373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.014697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.015007 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] PATH_INFO: `/v3/projects/27d342ebf79640c4905d409fbbe7d2fa` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.021345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d342ebf79640c4905d409fbbe7d2fa)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:59.026654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:59.108206 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c4dd4-76fa-4122-a601-964c00934960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:59.108206 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c4dd4-76fa-4122-a601-964c00934960 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.112108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c4dd4-76fa-4122-a601-964c00934960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.112495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c4dd4-76fa-4122-a601-964c00934960 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.117496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c4dd4-76fa-4122-a601-964c00934960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:59.127008 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c4dd4-76fa-4122-a601-964c00934960 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:59.250408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d342ebf79640c4905d409fbbe7d2fa', 'request_id': 'req-ba822e38-13f5-4b7f-8c63-e9f8a9103434'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:59.285804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 852/1703] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:12:58 2022] POST /identity/v3/users => generated 285 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:12:59.286840 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c4dd4-76fa-4122-a601-964c00934960 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:59.312720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c4dd4-76fa-4122-a601-964c00934960 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:59.328013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d342ebf79640c4905d409fbbe7d2fa', 'request_id': 'req-ba822e38-13f5-4b7f-8c63-e9f8a9103434'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:59.340292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d342ebf79640c4905d409fbbe7d2fa', 'request_id': 'req-ba822e38-13f5-4b7f-8c63-e9f8a9103434'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:59.346739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:12:59.402276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] The token cache is being invalidate because project 27d342ebf79640c4905d409fbbe7d2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:12:59.403764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:59.410873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba822e38-13f5-4b7f-8c63-e9f8a9103434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:12:59.416590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 852/1704] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:12:58 2022] DELETE /identity/v3/projects/27d342ebf79640c4905d409fbbe7d2fa => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:59.424507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f6ce-6610-45ff-b076-231f642ed106 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.429677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f6ce-6610-45ff-b076-231f642ed106 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.432894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11f6ce-6610-45ff-b076-231f642ed106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.481725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a16c2-2936-41d5-908a-bc48d52a342b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:59.483440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a16c2-2936-41d5-908a-bc48d52a342b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.484065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a16c2-2936-41d5-908a-bc48d52a342b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.484612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a16c2-2936-41d5-908a-bc48d52a342b admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.486558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a16c2-2936-41d5-908a-bc48d52a342b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:59.488690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a16c2-2936-41d5-908a-bc48d52a342b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:59.514335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-dc11f6ce-6610-45ff-b076-231f642ed106 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:59.518814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 853/1705] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:12:59.520390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a16c2-2936-41d5-908a-bc48d52a342b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:59.520649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-dc11f6ce-6610-45ff-b076-231f642ed106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:59.522764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-db2a16c2-2936-41d5-908a-bc48d52a342b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:59.549136 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 853/1706] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:59.558028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb600ec5-099a-4b0c-89d2-dfacd865f014 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.558770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb600ec5-099a-4b0c-89d2-dfacd865f014 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.559325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb600ec5-099a-4b0c-89d2-dfacd865f014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.565191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a16c2-2936-41d5-908a-bc48d52a342b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:59.588490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f32e22-ad5c-4638-bb83-001ac27fead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:59.592524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f32e22-ad5c-4638-bb83-001ac27fead9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.594233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f32e22-ad5c-4638-bb83-001ac27fead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.595433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f32e22-ad5c-4638-bb83-001ac27fead9 admin admin] PATH_INFO: `/v3/projects/e93b8babffe64b89a39dcd99562f42b8/users/0f3c2da330d04b70b9803ae53113ff79/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.643552 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-bb600ec5-099a-4b0c-89d2-dfacd865f014 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:12:59.650859 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-bb600ec5-099a-4b0c-89d2-dfacd865f014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:12:59.668898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f32e22-ad5c-4638-bb83-001ac27fead9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93b8babffe64b89a39dcd99562f42b8, user_id=0f3c2da330d04b70b9803ae53113ff79, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:59.680480 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f32e22-ad5c-4638-bb83-001ac27fead9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:59.690559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 854/1707] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:12:59.693983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb600ec5-099a-4b0c-89d2-dfacd865f014 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:59.742678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb600ec5-099a-4b0c-89d2-dfacd865f014 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:12:59.768877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48596f-d0a6-47f7-87a4-0c4917a153ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:12:59.772393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48596f-d0a6-47f7-87a4-0c4917a153ad admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:12:59.773524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48596f-d0a6-47f7-87a4-0c4917a153ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:12:59.774362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48596f-d0a6-47f7-87a4-0c4917a153ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:12:59.778758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48596f-d0a6-47f7-87a4-0c4917a153ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:12:59.782728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48596f-d0a6-47f7-87a4-0c4917a153ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:12:59.787163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48596f-d0a6-47f7-87a4-0c4917a153ad admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:12:59.796565 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 854/1708] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:12:59 2022] PUT /identity/v3/projects/e93b8babffe64b89a39dcd99562f42b8/users/0f3c2da330d04b70b9803ae53113ff79/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:12:59.801396 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f32e22-ad5c-4638-bb83-001ac27fead9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:59.847318 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 855/1709] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:12:59.855555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48596f-d0a6-47f7-87a4-0c4917a153ad admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:12:59.885076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48596f-d0a6-47f7-87a4-0c4917a153ad admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:00.045106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:00.082080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f32e22-ad5c-4638-bb83-001ac27fead9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:00.094131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add347fb-d7a2-4063-93c2-378d8b560ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:00.096444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add347fb-d7a2-4063-93c2-378d8b560ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:00.096977 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add347fb-d7a2-4063-93c2-378d8b560ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:00.097721 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add347fb-d7a2-4063-93c2-378d8b560ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:00.100413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e30e5a-71a4-4498-889e-cfff380e11fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:00.100678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add347fb-d7a2-4063-93c2-378d8b560ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:00.104691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e30e5a-71a4-4498-889e-cfff380e11fd admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:00.108346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e30e5a-71a4-4498-889e-cfff380e11fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:00.109106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e30e5a-71a4-4498-889e-cfff380e11fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:00.112539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add347fb-d7a2-4063-93c2-378d8b560ffa admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:00.113122 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e30e5a-71a4-4498-889e-cfff380e11fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:00.118965 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e30e5a-71a4-4498-889e-cfff380e11fd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:00.156860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 855/1710] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:00.158477 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e30e5a-71a4-4498-889e-cfff380e11fd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:00.193955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e30e5a-71a4-4498-889e-cfff380e11fd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:00.215438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e96021-93c1-4834-8048-96616fa2b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:00.218729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e96021-93c1-4834-8048-96616fa2b7a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:00.219019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e96021-93c1-4834-8048-96616fa2b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:00.227900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e96021-93c1-4834-8048-96616fa2b7a8 admin admin] PATH_INFO: `/v3/projects/e93b8babffe64b89a39dcd99562f42b8/users/0f3c2da330d04b70b9803ae53113ff79/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:00.232542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e96021-93c1-4834-8048-96616fa2b7a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93b8babffe64b89a39dcd99562f42b8, user_id=0f3c2da330d04b70b9803ae53113ff79, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:00.240373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e96021-93c1-4834-8048-96616fa2b7a8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:00.293562 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 856/1711] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:12:59 2022] POST /identity/v3/projects => generated 381 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:00.294808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add347fb-d7a2-4063-93c2-378d8b560ffa admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:00.312559 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 856/1712] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:00 2022] PUT /identity/v3/projects/e93b8babffe64b89a39dcd99562f42b8/users/0f3c2da330d04b70b9803ae53113ff79/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:00.335108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722164d3-988b-4fa0-b3ff-c9a96160a681 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:00.335430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722164d3-988b-4fa0-b3ff-c9a96160a681 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:00.335760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722164d3-988b-4fa0-b3ff-c9a96160a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:00.453615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-722164d3-988b-4fa0-b3ff-c9a96160a681 None None] MFA Rules not processed for user `0f3c2da330d04b70b9803ae53113ff79`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:00.454865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-722164d3-988b-4fa0-b3ff-c9a96160a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:00.593904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add347fb-d7a2-4063-93c2-378d8b560ffa admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:00.618119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3db89-3082-4aa1-bc9c-02104f2fdf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:00.625450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3db89-3082-4aa1-bc9c-02104f2fdf88 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:00.625450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3db89-3082-4aa1-bc9c-02104f2fdf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:00.625450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3db89-3082-4aa1-bc9c-02104f2fdf88 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:00.625450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3db89-3082-4aa1-bc9c-02104f2fdf88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:00.636458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:00.644434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3db89-3082-4aa1-bc9c-02104f2fdf88 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:00.670867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 857/1713] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:00 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:00.672718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0ccc-5e54-416d-ae82-a0ffc35cf199 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:00.673176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0ccc-5e54-416d-ae82-a0ffc35cf199 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:00.673605 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e0ccc-5e54-416d-ae82-a0ffc35cf199 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:00.675563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 858/1714] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jun 2 10:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:00.683843 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296e0f-2b75-44fe-932e-6a2421ea24ae None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:00.688686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296e0f-2b75-44fe-932e-6a2421ea24ae None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:00.688686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3296e0f-2b75-44fe-932e-6a2421ea24ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:00.744474 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 857/1715] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:00 2022] POST /identity/v3/users => generated 291 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:00.745611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3db89-3082-4aa1-bc9c-02104f2fdf88 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:00.752407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-19a3db89-3082-4aa1-bc9c-02104f2fdf88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:00.757101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b3296e0f-2b75-44fe-932e-6a2421ea24ae None None] MFA Rules not processed for user `d9263fa2ac534b7b9e5c6658c871da9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:00.768724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b3296e0f-2b75-44fe-932e-6a2421ea24ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:00.991349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 859/1716] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:13:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:00.992503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296e0f-2b75-44fe-932e-6a2421ea24ae None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:00.999624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3db89-3082-4aa1-bc9c-02104f2fdf88 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:01.020348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3296e0f-2b75-44fe-932e-6a2421ea24ae None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:01.026657 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9c8fa-3c39-45dc-97eb-47274523c267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:01.027609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c8fa-3c39-45dc-97eb-47274523c267 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.027937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c8fa-3c39-45dc-97eb-47274523c267 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.028766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9c8fa-3c39-45dc-97eb-47274523c267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.037923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252ba80-4bee-4469-92aa-f09f776cf76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:01.038625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252ba80-4bee-4469-92aa-f09f776cf76d admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.038981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252ba80-4bee-4469-92aa-f09f776cf76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.039373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252ba80-4bee-4469-92aa-f09f776cf76d admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.040100 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252ba80-4bee-4469-92aa-f09f776cf76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:01.051090 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252ba80-4bee-4469-92aa-f09f776cf76d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:01.052595 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9c8fa-3c39-45dc-97eb-47274523c267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:01.054340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9c8fa-3c39-45dc-97eb-47274523c267 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:01.079433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 860/1717] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:01.082631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca27fc-0e54-4529-93c8-91e391d2c20a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.082934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca27fc-0e54-4529-93c8-91e391d2c20a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.083218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca27fc-0e54-4529-93c8-91e391d2c20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.090281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 858/1718] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:00 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:01.101442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9c8fa-3c39-45dc-97eb-47274523c267 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:01.109559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6ec9c8fa-3c39-45dc-97eb-47274523c267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:01.177201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9c8fa-3c39-45dc-97eb-47274523c267 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:01.178355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-11ca27fc-0e54-4529-93c8-91e391d2c20a None None] MFA Rules not processed for user `d9263fa2ac534b7b9e5c6658c871da9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:01.179899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-11ca27fc-0e54-4529-93c8-91e391d2c20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:01.193587 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b446e2b-d2c5-49af-9df6-ace24d799b3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:01.198099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b446e2b-d2c5-49af-9df6-ace24d799b3e service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.199930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b446e2b-d2c5-49af-9df6-ace24d799b3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.204655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b446e2b-d2c5-49af-9df6-ace24d799b3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.212508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 861/1719] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jun 2 10:13:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:01.213397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca27fc-0e54-4529-93c8-91e391d2c20a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:01.254330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b446e2b-d2c5-49af-9df6-ace24d799b3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:01.264627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b446e2b-d2c5-49af-9df6-ace24d799b3e service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:01.292007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca27fc-0e54-4529-93c8-91e391d2c20a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:01.318535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 859/1720] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:01.332624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125e2da-1606-4f0e-87d8-aa052fcd6323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:01.334172 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125e2da-1606-4f0e-87d8-aa052fcd6323 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.335609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125e2da-1606-4f0e-87d8-aa052fcd6323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.339777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:01.341621 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b446e2b-d2c5-49af-9df6-ace24d799b3e service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:01.342386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125e2da-1606-4f0e-87d8-aa052fcd6323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.345324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125e2da-1606-4f0e-87d8-aa052fcd6323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:01.351418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9b446e2b-d2c5-49af-9df6-ace24d799b3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:01.354468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125e2da-1606-4f0e-87d8-aa052fcd6323 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:01.388193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 862/1721] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:01.393438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125e2da-1606-4f0e-87d8-aa052fcd6323 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:01.414696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b446e2b-d2c5-49af-9df6-ace24d799b3e service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:01.426752 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125e2da-1606-4f0e-87d8-aa052fcd6323 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:01.445228 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc8a67-ff58-4004-9ee7-ef67312e0dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:01.450473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817bfd1-38e4-4a27-844e-d9b429dfe08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:01.450473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817bfd1-38e4-4a27-844e-d9b429dfe08f admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.450473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817bfd1-38e4-4a27-844e-d9b429dfe08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.451880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc8a67-ff58-4004-9ee7-ef67312e0dbd service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.454858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc8a67-ff58-4004-9ee7-ef67312e0dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.456969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817bfd1-38e4-4a27-844e-d9b429dfe08f admin admin] PATH_INFO: `/v3/projects/9fa8cdb01fee46e7902b6e40b6138139/users/395d591b35b1443b8737462411547506/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.464241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc8a67-ff58-4004-9ee7-ef67312e0dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.502771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc8a67-ff58-4004-9ee7-ef67312e0dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:01.532667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc8a67-ff58-4004-9ee7-ef67312e0dbd service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:01.549400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817bfd1-38e4-4a27-844e-d9b429dfe08f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa8cdb01fee46e7902b6e40b6138139, user_id=395d591b35b1443b8737462411547506, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:01.552158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817bfd1-38e4-4a27-844e-d9b429dfe08f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:01.570331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 860/1722] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:01.571548 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc8a67-ff58-4004-9ee7-ef67312e0dbd service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:01.617252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc8a67-ff58-4004-9ee7-ef67312e0dbd service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:01.631715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914c38-4ecf-4143-92cf-241eddd174c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:01.632474 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914c38-4ecf-4143-92cf-241eddd174c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.632771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914c38-4ecf-4143-92cf-241eddd174c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.633061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23914c38-4ecf-4143-92cf-241eddd174c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.646240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-23914c38-4ecf-4143-92cf-241eddd174c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:01.671525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 863/1723] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:01 2022] PUT /identity/v3/projects/9fa8cdb01fee46e7902b6e40b6138139/users/395d591b35b1443b8737462411547506/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:01.684003 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99c0cc-6570-4bfc-833e-d6dd00cef144 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:01.684557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99c0cc-6570-4bfc-833e-d6dd00cef144 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:01.684986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99c0cc-6570-4bfc-833e-d6dd00cef144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:01.784672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3a99c0cc-6570-4bfc-833e-d6dd00cef144 None None] MFA Rules not processed for user `395d591b35b1443b8737462411547506`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:01.800869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3a99c0cc-6570-4bfc-833e-d6dd00cef144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:01.906329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23914c38-4ecf-4143-92cf-241eddd174c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:01.910932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23914c38-4ecf-4143-92cf-241eddd174c8 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:01.945566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 861/1724] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:01 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:01.946530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914c38-4ecf-4143-92cf-241eddd174c8 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:01.949055 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-23914c38-4ecf-4143-92cf-241eddd174c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:01.998668 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23914c38-4ecf-4143-92cf-241eddd174c8 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:02.020868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 864/1725] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:02.025129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99c0cc-6570-4bfc-833e-d6dd00cef144 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:02.200080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:02.249370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99c0cc-6570-4bfc-833e-d6dd00cef144 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:02.260558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817ec4-a984-4494-94b7-f5ce478b7f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:02.261392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817ec4-a984-4494-94b7-f5ce478b7f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:02.263909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817ec4-a984-4494-94b7-f5ce478b7f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:02.264260 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26817ec4-a984-4494-94b7-f5ce478b7f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:02.269860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26817ec4-a984-4494-94b7-f5ce478b7f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:02.272134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26817ec4-a984-4494-94b7-f5ce478b7f15 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:02.275526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:02.277660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:02.286359 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:02.287023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] PATH_INFO: `/v3/users/ceff6224d4d14f3a8e1a661e1ddd7bc9` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:02.288731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceff6224d4d14f3a8e1a661e1ddd7bc9)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:02.298178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:02.413218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 865/1726] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:02 2022] POST /identity/v3/projects => generated 381 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:02.417036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817ec4-a984-4494-94b7-f5ce478b7f15 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:02.597375 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26817ec4-a984-4494-94b7-f5ce478b7f15 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:02.608764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceff6224d4d14f3a8e1a661e1ddd7bc9'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.611882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610f745-ba28-463c-900f-133cc0366125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:02.612651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610f745-ba28-463c-900f-133cc0366125 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:02.612943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610f745-ba28-463c-900f-133cc0366125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:02.613223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610f745-ba28-463c-900f-133cc0366125 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:02.614349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610f745-ba28-463c-900f-133cc0366125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:02.620861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610f745-ba28-463c-900f-133cc0366125 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:02.652385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceff6224d4d14f3a8e1a661e1ddd7bc9'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.673443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceff6224d4d14f3a8e1a661e1ddd7bc9'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.722924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceff6224d4d14f3a8e1a661e1ddd7bc9'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.723780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceff6224d4d14f3a8e1a661e1ddd7bc9'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:02.761279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 866/1727] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:02 2022] POST /identity/v3/users => generated 297 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:02.762758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec39611-e108-4f03-8ab5-d9b5a2ddbb04 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:02.763769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec39611-e108-4f03-8ab5-d9b5a2ddbb04 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:02.764685 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec39611-e108-4f03-8ab5-d9b5a2ddbb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:02.851104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1ec39611-e108-4f03-8ab5-d9b5a2ddbb04 None None] MFA Rules not processed for user `c7704f30352a4b7b8b8ee9019d86f50a`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:02.851932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:02.855603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1ec39611-e108-4f03-8ab5-d9b5a2ddbb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:02.872167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 862/1728] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:01 2022] DELETE /identity/v3/users/ceff6224d4d14f3a8e1a661e1ddd7bc9 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:02.891165 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:02.896062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:03.150740 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 867/1729] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:03.152421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb5fc6-761f-4c82-80f6-048a26c70411 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:03.152775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb5fc6-761f-4c82-80f6-048a26c70411 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:03.153145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb5fc6-761f-4c82-80f6-048a26c70411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:03.185103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4572a5c-66cb-49ca-bc34-fec556fddabc admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:03.210479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b1fb5fc6-761f-4c82-80f6-048a26c70411 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:03.211095 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20701b10-e42a-4386-8369-d9711d5479d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:03.211612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20701b10-e42a-4386-8369-d9711d5479d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:03.211875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20701b10-e42a-4386-8369-d9711d5479d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:03.212150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20701b10-e42a-4386-8369-d9711d5479d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:03.212903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20701b10-e42a-4386-8369-d9711d5479d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:03.214555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20701b10-e42a-4386-8369-d9711d5479d6 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:03.217420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b1fb5fc6-761f-4c82-80f6-048a26c70411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:03.237840 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 868/1730] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:03.238941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb5fc6-761f-4c82-80f6-048a26c70411 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:03.240889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b1fb5fc6-761f-4c82-80f6-048a26c70411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:03.250484 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 863/1731] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:03.252897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20701b10-e42a-4386-8369-d9711d5479d6 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:03.255397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-20701b10-e42a-4386-8369-d9711d5479d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:03.345533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:03.413526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20701b10-e42a-4386-8369-d9711d5479d6 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:03.426532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb5fc6-761f-4c82-80f6-048a26c70411 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:03.439551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4a29c-f92f-4bcc-8fd4-b2c1bd1e549f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:03.440997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a29c-f92f-4bcc-8fd4-b2c1bd1e549f service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:03.441457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a29c-f92f-4bcc-8fd4-b2c1bd1e549f service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:03.442018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a29c-f92f-4bcc-8fd4-b2c1bd1e549f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:03.447281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acc4f7-8cec-4623-8dd8-04e9b401f200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:03.448067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acc4f7-8cec-4623-8dd8-04e9b401f200 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:03.448756 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acc4f7-8cec-4623-8dd8-04e9b401f200 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:03.449078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acc4f7-8cec-4623-8dd8-04e9b401f200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:03.465736 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4a29c-f92f-4bcc-8fd4-b2c1bd1e549f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:03.493125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4a29c-f92f-4bcc-8fd4-b2c1bd1e549f service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:03.527629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 864/1732] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:03.538760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4a29c-f92f-4bcc-8fd4-b2c1bd1e549f service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:03.585013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4a29c-f92f-4bcc-8fd4-b2c1bd1e549f service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:03.601087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696a709-fd12-4614-b46f-77ed9fb0ecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:03.602055 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696a709-fd12-4614-b46f-77ed9fb0ecab admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:03.602442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696a709-fd12-4614-b46f-77ed9fb0ecab admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:03.602851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696a709-fd12-4614-b46f-77ed9fb0ecab admin admin] PATH_INFO: `/v3/projects/af3b7beeada34f2eac10e0eaf2099cca/users/ad3e865df66b4acb84ae68bd0177eff3/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:03.651646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acc4f7-8cec-4623-8dd8-04e9b401f200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:03.652645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acc4f7-8cec-4623-8dd8-04e9b401f200 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:03.659117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696a709-fd12-4614-b46f-77ed9fb0ecab admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3b7beeada34f2eac10e0eaf2099cca, user_id=ad3e865df66b4acb84ae68bd0177eff3, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:03.677674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696a709-fd12-4614-b46f-77ed9fb0ecab admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:03.692223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 869/1733] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:03.711344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17f4b6-9ba5-40ea-8e89-792d7deee7dd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:03.711632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17f4b6-9ba5-40ea-8e89-792d7deee7dd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:03.711921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17f4b6-9ba5-40ea-8e89-792d7deee7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:03.800410 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 865/1734] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:03 2022] PUT /identity/v3/projects/af3b7beeada34f2eac10e0eaf2099cca/users/ad3e865df66b4acb84ae68bd0177eff3/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:03.805882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4b17f4b6-9ba5-40ea-8e89-792d7deee7dd None None] MFA Rules not processed for user `378532c2b45a4b3b91857c0fc5cb8179`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:03.809173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696a709-fd12-4614-b46f-77ed9fb0ecab admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:03.812573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4b17f4b6-9ba5-40ea-8e89-792d7deee7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:04.031264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 870/1735] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:04.081878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696a709-fd12-4614-b46f-77ed9fb0ecab admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:04.093869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f439b69-d1a5-428d-bccb-a876f3d6e0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:04.093869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439b69-d1a5-428d-bccb-a876f3d6e0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:04.093869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439b69-d1a5-428d-bccb-a876f3d6e0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:04.102750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f439b69-d1a5-428d-bccb-a876f3d6e0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:04.103708 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f439b69-d1a5-428d-bccb-a876f3d6e0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:04.109486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f439b69-d1a5-428d-bccb-a876f3d6e0f1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:04.148614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 866/1736] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:04.152299 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17f4b6-9ba5-40ea-8e89-792d7deee7dd None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:04.180274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17f4b6-9ba5-40ea-8e89-792d7deee7dd None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:04.202488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2113cf7-95b0-402a-b0c0-ad018b1b71b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:04.205191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2113cf7-95b0-402a-b0c0-ad018b1b71b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:04.205481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2113cf7-95b0-402a-b0c0-ad018b1b71b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:04.208474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2113cf7-95b0-402a-b0c0-ad018b1b71b2 admin admin] PATH_INFO: `/v3/projects/af3b7beeada34f2eac10e0eaf2099cca/users/ad3e865df66b4acb84ae68bd0177eff3/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:04.215662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2113cf7-95b0-402a-b0c0-ad018b1b71b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3b7beeada34f2eac10e0eaf2099cca, user_id=ad3e865df66b4acb84ae68bd0177eff3, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:04.233308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2113cf7-95b0-402a-b0c0-ad018b1b71b2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:04.289651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 871/1737] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:04 2022] PUT /identity/v3/projects/af3b7beeada34f2eac10e0eaf2099cca/users/ad3e865df66b4acb84ae68bd0177eff3/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:04.306328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699ef91-eaa5-44fc-a35d-3b8439a00ecd None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:04.306637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699ef91-eaa5-44fc-a35d-3b8439a00ecd None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:04.306907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699ef91-eaa5-44fc-a35d-3b8439a00ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:04.411409 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f699ef91-eaa5-44fc-a35d-3b8439a00ecd None None] MFA Rules not processed for user `ad3e865df66b4acb84ae68bd0177eff3`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:04.415841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f699ef91-eaa5-44fc-a35d-3b8439a00ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:04.715799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 867/1738] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:04.727774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2113cf7-95b0-402a-b0c0-ad018b1b71b2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:04.729808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d2113cf7-95b0-402a-b0c0-ad018b1b71b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:04.835203 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2113cf7-95b0-402a-b0c0-ad018b1b71b2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:04.840471 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ae22b-6670-4966-876c-46f19c74ee50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:04.841793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae22b-6670-4966-876c-46f19c74ee50 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:04.842548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae22b-6670-4966-876c-46f19c74ee50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:04.843009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ae22b-6670-4966-876c-46f19c74ee50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:04.850766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:04.855712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ae22b-6670-4966-876c-46f19c74ee50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:04.866641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ae22b-6670-4966-876c-46f19c74ee50 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:04.889419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 872/1739] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:05.105732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699ef91-eaa5-44fc-a35d-3b8439a00ecd None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:05.123050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699ef91-eaa5-44fc-a35d-3b8439a00ecd None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:05.138525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304460a-0a54-465a-b2d0-349dfaef8eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:05.139217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304460a-0a54-465a-b2d0-349dfaef8eca service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:05.139502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304460a-0a54-465a-b2d0-349dfaef8eca service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:05.139804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304460a-0a54-465a-b2d0-349dfaef8eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:05.170163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-0304460a-0a54-465a-b2d0-349dfaef8eca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:05.218580 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ae22b-6670-4966-876c-46f19c74ee50 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:05.226896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c90ae22b-6670-4966-876c-46f19c74ee50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:05.245522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:05.329786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304460a-0a54-465a-b2d0-349dfaef8eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:05.331775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304460a-0a54-465a-b2d0-349dfaef8eca service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:05.344924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 868/1740] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:05.459020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ae22b-6670-4966-876c-46f19c74ee50 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:05.494314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:05.499134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:05.500646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:05.502030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] PATH_INFO: `/v3/projects/8d384f5d23fe44fab814de979c385cd6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:05.506689 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d384f5d23fe44fab814de979c385cd6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:05.516021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:05.799200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d384f5d23fe44fab814de979c385cd6', 'request_id': 'req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.832700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d384f5d23fe44fab814de979c385cd6', 'request_id': 'req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:05.891312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d384f5d23fe44fab814de979c385cd6', 'request_id': 'req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:06.001411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] The token cache is being invalidate because project 8d384f5d23fe44fab814de979c385cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:06.001694 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:06.003471 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a1adbf5e-0c2a-4ced-b47d-6a6e88ef54fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:06.007181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 873/1741] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:05 2022] DELETE /identity/v3/projects/8d384f5d23fe44fab814de979c385cd6 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:06.012107 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304460a-0a54-465a-b2d0-349dfaef8eca service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:06.036861 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304460a-0a54-465a-b2d0-349dfaef8eca service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:06.113036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffb99-c6ea-4135-ba8b-8999687b0442 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.113658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffb99-c6ea-4135-ba8b-8999687b0442 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.114216 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ffb99-c6ea-4135-ba8b-8999687b0442 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.120105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 874/1742] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:13:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:06.268485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:06.275485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.280515 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.280986 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] PATH_INFO: `/v3/users/92027b6a308a4b7daa9942ab88389bb2` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.287265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92027b6a308a4b7daa9942ab88389bb2)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:06.296346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:06.328003 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45931cb9-2fd9-49fd-ae78-f9a2f7d0aa49 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:06.329007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45931cb9-2fd9-49fd-ae78-f9a2f7d0aa49 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:06.329434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45931cb9-2fd9-49fd-ae78-f9a2f7d0aa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:06.439208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-45931cb9-2fd9-49fd-ae78-f9a2f7d0aa49 None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:06.444190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-45931cb9-2fd9-49fd-ae78-f9a2f7d0aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:06.683343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92027b6a308a4b7daa9942ab88389bb2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:06.704561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 875/1743] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:13:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:06.728238 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92027b6a308a4b7daa9942ab88389bb2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:06.731387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92027b6a308a4b7daa9942ab88389bb2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:06.791573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92027b6a308a4b7daa9942ab88389bb2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:06.799383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92027b6a308a4b7daa9942ab88389bb2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:06.916545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 869/1744] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:06 2022] DELETE /identity/v3/users/92027b6a308a4b7daa9942ab88389bb2 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:07.077469 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:07.125729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45931cb9-2fd9-49fd-ae78-f9a2f7d0aa49 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:07.127406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-45931cb9-2fd9-49fd-ae78-f9a2f7d0aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:07.165551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45931cb9-2fd9-49fd-ae78-f9a2f7d0aa49 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:07.353657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:07.474481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8d94b-9da1-4ef9-9349-efa53531e8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:07.475352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d94b-9da1-4ef9-9349-efa53531e8d3 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:07.475896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d94b-9da1-4ef9-9349-efa53531e8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:07.477658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d94b-9da1-4ef9-9349-efa53531e8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:07.480710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1ed8d94b-9da1-4ef9-9349-efa53531e8d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:07.514911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8d94b-9da1-4ef9-9349-efa53531e8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:07.525622 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8d94b-9da1-4ef9-9349-efa53531e8d3 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:07.578917 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 876/1745] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:08.983362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:08.984968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:09.213523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab66538-b404-4dc5-866b-86e35d657997 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:09.225515 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:09.226810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.227243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.227706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] PATH_INFO: `/v3/projects/511f97c3ae9e42efbe26e2a349292a17` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:09.230797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=511f97c3ae9e42efbe26e2a349292a17)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:09.235335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:09.517525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511f97c3ae9e42efbe26e2a349292a17', 'request_id': 'req-3cef8163-bdd9-4e36-859c-2a916886be1a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:09.604883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511f97c3ae9e42efbe26e2a349292a17', 'request_id': 'req-3cef8163-bdd9-4e36-859c-2a916886be1a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:09.615454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511f97c3ae9e42efbe26e2a349292a17', 'request_id': 'req-3cef8163-bdd9-4e36-859c-2a916886be1a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:09.646990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] The token cache is being invalidate because project 511f97c3ae9e42efbe26e2a349292a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:09.647312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:09.648027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-3cef8163-bdd9-4e36-859c-2a916886be1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:09.650302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 870/1746] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:08 2022] DELETE /identity/v3/projects/511f97c3ae9e42efbe26e2a349292a17 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:09.656583 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9783-cc14-4441-8106-b15cda3dab87 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.657469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9783-cc14-4441-8106-b15cda3dab87 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.657906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9783-cc14-4441-8106-b15cda3dab87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:09.703778 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-cabc9783-cc14-4441-8106-b15cda3dab87 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:09.709065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cabc9783-cc14-4441-8106-b15cda3dab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:09.953070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 877/1747] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:09.961888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe441-1d06-4b35-9daf-2d4a623ac0a7 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:09.962185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe441-1d06-4b35-9daf-2d4a623ac0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:09.962470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe441-1d06-4b35-9daf-2d4a623ac0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.016195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-05afe441-1d06-4b35-9daf-2d4a623ac0a7 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:10.025596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-05afe441-1d06-4b35-9daf-2d4a623ac0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:10.047194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 871/1748] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:10.051735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9783-cc14-4441-8106-b15cda3dab87 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:10.069733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9783-cc14-4441-8106-b15cda3dab87 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:10.087632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc83a5-6ab2-4859-a7da-e6d199c4e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:10.089039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc83a5-6ab2-4859-a7da-e6d199c4e805 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.089039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc83a5-6ab2-4859-a7da-e6d199c4e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.089475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc83a5-6ab2-4859-a7da-e6d199c4e805 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.090474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc83a5-6ab2-4859-a7da-e6d199c4e805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:10.091504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc83a5-6ab2-4859-a7da-e6d199c4e805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:10.094995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc83a5-6ab2-4859-a7da-e6d199c4e805 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:10.130145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 878/1749] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:10.132293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afe441-1d06-4b35-9daf-2d4a623ac0a7 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:10.152661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afe441-1d06-4b35-9daf-2d4a623ac0a7 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:10.164790 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9488402-f396-4c4e-bace-70c02fcf5916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:10.165843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9488402-f396-4c4e-bace-70c02fcf5916 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.166287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9488402-f396-4c4e-bace-70c02fcf5916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.166791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9488402-f396-4c4e-bace-70c02fcf5916 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.167779 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9488402-f396-4c4e-bace-70c02fcf5916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:10.171166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9488402-f396-4c4e-bace-70c02fcf5916 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:10.283811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78156-41df-4309-a46a-f9d181be835b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.283811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78156-41df-4309-a46a-f9d181be835b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.283811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78156-41df-4309-a46a-f9d181be835b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.319000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 872/1750] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:10 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:10.323845 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9488402-f396-4c4e-bace-70c02fcf5916 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:10.352821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:10.355967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-22f78156-41df-4309-a46a-f9d181be835b None None] MFA Rules not processed for user `0439579b269b4fdd927ce404937ba204`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:10.360210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-22f78156-41df-4309-a46a-f9d181be835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:10.471859 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9488402-f396-4c4e-bace-70c02fcf5916 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:10.478747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15191a-124d-412e-a385-fbf55835319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:10.496330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15191a-124d-412e-a385-fbf55835319e admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.498385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15191a-124d-412e-a385-fbf55835319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.498769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15191a-124d-412e-a385-fbf55835319e admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.500091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15191a-124d-412e-a385-fbf55835319e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:10.502944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15191a-124d-412e-a385-fbf55835319e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:10.537239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 879/1751] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:10.538522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78156-41df-4309-a46a-f9d181be835b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:10.539924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-22f78156-41df-4309-a46a-f9d181be835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:10.562916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78156-41df-4309-a46a-f9d181be835b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:10.569589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26173245-d02c-42ed-b8ba-5aabaf05a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:10.570562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26173245-d02c-42ed-b8ba-5aabaf05a8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.570848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26173245-d02c-42ed-b8ba-5aabaf05a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.571131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26173245-d02c-42ed-b8ba-5aabaf05a8ae admin admin] PATH_INFO: `/v3/users/395d591b35b1443b8737462411547506` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.572581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26173245-d02c-42ed-b8ba-5aabaf05a8ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=395d591b35b1443b8737462411547506)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:10.574788 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26173245-d02c-42ed-b8ba-5aabaf05a8ae admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:10.661093 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 873/1752] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:10 2022] POST /identity/v3/users => generated 288 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:10.679025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9acb4d-397b-4152-a70e-4b0265852833 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:10.685790 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9acb4d-397b-4152-a70e-4b0265852833 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:10.686319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9acb4d-397b-4152-a70e-4b0265852833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:10.780931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-6e9acb4d-397b-4152-a70e-4b0265852833 None None] MFA Rules not processed for user `b8ee3e13db3746d69529e75537b1cb66`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:10.782547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6e9acb4d-397b-4152-a70e-4b0265852833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:10.932782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:10.949189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-26173245-d02c-42ed-b8ba-5aabaf05a8ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395d591b35b1443b8737462411547506'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:10.952313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 874/1753] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:10.953268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9acb4d-397b-4152-a70e-4b0265852833 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:10.990682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9acb4d-397b-4152-a70e-4b0265852833 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:11.019608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f4273-cf76-4a5d-a1c9-50bc84e9436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:11.021386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4273-cf76-4a5d-a1c9-50bc84e9436d admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.022011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4273-cf76-4a5d-a1c9-50bc84e9436d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.025374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f4273-cf76-4a5d-a1c9-50bc84e9436d admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.032383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f4273-cf76-4a5d-a1c9-50bc84e9436d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:11.042435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f4273-cf76-4a5d-a1c9-50bc84e9436d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:11.088855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 875/1754] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:11.093081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-26173245-d02c-42ed-b8ba-5aabaf05a8ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395d591b35b1443b8737462411547506'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:11.097286 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f4273-cf76-4a5d-a1c9-50bc84e9436d admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:11.125447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f4273-cf76-4a5d-a1c9-50bc84e9436d admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:11.140339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-26173245-d02c-42ed-b8ba-5aabaf05a8ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395d591b35b1443b8737462411547506'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:11.142650 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca08a9-dcf9-4bc8-b447-d40ec3f6a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:11.143103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-26173245-d02c-42ed-b8ba-5aabaf05a8ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395d591b35b1443b8737462411547506'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:11.144787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca08a9-dcf9-4bc8-b447-d40ec3f6a2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.146999 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-26173245-d02c-42ed-b8ba-5aabaf05a8ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395d591b35b1443b8737462411547506'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:11.147714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca08a9-dcf9-4bc8-b447-d40ec3f6a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.147714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca08a9-dcf9-4bc8-b447-d40ec3f6a2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.148341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca08a9-dcf9-4bc8-b447-d40ec3f6a2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:11.150006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca08a9-dcf9-4bc8-b447-d40ec3f6a2eb admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:11.182409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 880/1755] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:10 2022] DELETE /identity/v3/users/395d591b35b1443b8737462411547506 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:11.188556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b327-636e-4380-ab1a-b30153f82939 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.188852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b327-636e-4380-ab1a-b30153f82939 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.189135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7b327-636e-4380-ab1a-b30153f82939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.214546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 876/1756] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:11.216615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca08a9-dcf9-4bc8-b447-d40ec3f6a2eb admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:11.225290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-97ca08a9-dcf9-4bc8-b447-d40ec3f6a2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:11.229821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-02b7b327-636e-4380-ab1a-b30153f82939 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:11.231014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-02b7b327-636e-4380-ab1a-b30153f82939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:11.422928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca08a9-dcf9-4bc8-b447-d40ec3f6a2eb admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:11.444698 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 881/1757] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:11.445971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7b327-636e-4380-ab1a-b30153f82939 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:11.449006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-02b7b327-636e-4380-ab1a-b30153f82939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:11.490670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7b327-636e-4380-ab1a-b30153f82939 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:11.511040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97325-ca47-4b35-8fc3-1389a2b86781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:11.512031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97325-ca47-4b35-8fc3-1389a2b86781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.512320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97325-ca47-4b35-8fc3-1389a2b86781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.512778 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d97325-ca47-4b35-8fc3-1389a2b86781 admin admin] PATH_INFO: `/v3/projects/78211f94234a4e3fbe554e5f7085a111/users/effb6e01e29144f28336a4d5083da2c3/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.558108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d97325-ca47-4b35-8fc3-1389a2b86781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78211f94234a4e3fbe554e5f7085a111, user_id=effb6e01e29144f28336a4d5083da2c3, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:11.568984 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d97325-ca47-4b35-8fc3-1389a2b86781 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:11.630179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10145a50-e98f-419e-b72a-5a2c4c4acd6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:11.631319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10145a50-e98f-419e-b72a-5a2c4c4acd6a service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.631740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10145a50-e98f-419e-b72a-5a2c4c4acd6a service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.632119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10145a50-e98f-419e-b72a-5a2c4c4acd6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.635479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-10145a50-e98f-419e-b72a-5a2c4c4acd6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:11.708915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 882/1758] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:11 2022] PUT /identity/v3/projects/78211f94234a4e3fbe554e5f7085a111/users/effb6e01e29144f28336a4d5083da2c3/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:11.710703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97325-ca47-4b35-8fc3-1389a2b86781 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:11.719768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-42d97325-ca47-4b35-8fc3-1389a2b86781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:11.865212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10145a50-e98f-419e-b72a-5a2c4c4acd6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:11.868343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10145a50-e98f-419e-b72a-5a2c4c4acd6a service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:11.902182 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 877/1759] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:11.905651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c21938-44b4-4891-8a4b-8644ea0cafbc None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:11.909218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c21938-44b4-4891-8a4b-8644ea0cafbc None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:11.910940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c21938-44b4-4891-8a4b-8644ea0cafbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:11.976816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d97325-ca47-4b35-8fc3-1389a2b86781 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:11.992825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f840f-f45b-41ab-812e-3b3f09be0693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:11.997745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-67c21938-44b4-4891-8a4b-8644ea0cafbc None None] MFA Rules not processed for user `effb6e01e29144f28336a4d5083da2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:11.998619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-67c21938-44b4-4891-8a4b-8644ea0cafbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:12.006017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f840f-f45b-41ab-812e-3b3f09be0693 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:12.006564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f840f-f45b-41ab-812e-3b3f09be0693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:12.006947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f840f-f45b-41ab-812e-3b3f09be0693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:12.129935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 878/1760] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:12.131298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c21938-44b4-4891-8a4b-8644ea0cafbc None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:12.211951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f840f-f45b-41ab-812e-3b3f09be0693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:12.213628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f840f-f45b-41ab-812e-3b3f09be0693 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:12.243676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 883/1761] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:12.282046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c21938-44b4-4891-8a4b-8644ea0cafbc None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:12.299803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294af1-b723-4538-967f-1092b809edfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:12.299803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294af1-b723-4538-967f-1092b809edfc admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:12.299803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294af1-b723-4538-967f-1092b809edfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:12.299803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2294af1-b723-4538-967f-1092b809edfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:12.300635 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2294af1-b723-4538-967f-1092b809edfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:12.300635 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2294af1-b723-4538-967f-1092b809edfc admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:12.456449 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:12.551722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f840f-f45b-41ab-812e-3b3f09be0693 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:12.563907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 879/1762] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:12 2022] POST /identity/v3/projects => generated 377 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:12.568240 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f840f-f45b-41ab-812e-3b3f09be0693 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:12.739076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:12.761541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c601ee-49de-4b10-83d5-1ac7ab6d4c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:12.762794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c601ee-49de-4b10-83d5-1ac7ab6d4c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:12.763351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c601ee-49de-4b10-83d5-1ac7ab6d4c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:12.765332 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c601ee-49de-4b10-83d5-1ac7ab6d4c62 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:12.766293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c601ee-49de-4b10-83d5-1ac7ab6d4c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:12.770105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c601ee-49de-4b10-83d5-1ac7ab6d4c62 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:12.933825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 884/1763] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:12 2022] POST /identity/v3/users => generated 295 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:12.937535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294af1-b723-4538-967f-1092b809edfc admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:12.964716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2294af1-b723-4538-967f-1092b809edfc admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:12.984993 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68860528-6f86-49e4-b733-ac5a83b9fa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:12.986809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68860528-6f86-49e4-b733-ac5a83b9fa56 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:12.987112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68860528-6f86-49e4-b733-ac5a83b9fa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:12.987392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68860528-6f86-49e4-b733-ac5a83b9fa56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:12.996006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68860528-6f86-49e4-b733-ac5a83b9fa56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:12.996006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68860528-6f86-49e4-b733-ac5a83b9fa56 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:13.025793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 880/1764] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:13.030429 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c601ee-49de-4b10-83d5-1ac7ab6d4c62 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:13.047873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c601ee-49de-4b10-83d5-1ac7ab6d4c62 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:13.063308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1a250-bcdd-4936-abeb-05cf48961a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:13.077048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1a250-bcdd-4936-abeb-05cf48961a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:13.077801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1a250-bcdd-4936-abeb-05cf48961a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:13.079912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1a250-bcdd-4936-abeb-05cf48961a09 admin admin] PATH_INFO: `/v3/projects/e6a5f874558a4176869d3b314711b4d6/users/4c0fbff2e80441b78765349658b2940e/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:13.149195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1a250-bcdd-4936-abeb-05cf48961a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a5f874558a4176869d3b314711b4d6, user_id=4c0fbff2e80441b78765349658b2940e, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:13.156585 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1a250-bcdd-4936-abeb-05cf48961a09 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:13.277414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 885/1765] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:13 2022] PUT /identity/v3/projects/e6a5f874558a4176869d3b314711b4d6/users/4c0fbff2e80441b78765349658b2940e/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:13.281821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68860528-6f86-49e4-b733-ac5a83b9fa56 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:13.311911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68860528-6f86-49e4-b733-ac5a83b9fa56 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:13.454176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1c0be-9350-4a8a-b8dd-c694d338e1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:13.455389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1c0be-9350-4a8a-b8dd-c694d338e1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:13.456020 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1c0be-9350-4a8a-b8dd-c694d338e1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:13.456543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1c0be-9350-4a8a-b8dd-c694d338e1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:13.460174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1c0be-9350-4a8a-b8dd-c694d338e1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:13.472989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1c0be-9350-4a8a-b8dd-c694d338e1d2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:13.491702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 881/1766] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:13.496181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1a250-bcdd-4936-abeb-05cf48961a09 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:13.516348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1a250-bcdd-4936-abeb-05cf48961a09 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:13.540757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f29b41-371a-4ff1-8c42-ebf3d3485487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:13.545743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29b41-371a-4ff1-8c42-ebf3d3485487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:13.546210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29b41-371a-4ff1-8c42-ebf3d3485487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:13.550184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f29b41-371a-4ff1-8c42-ebf3d3485487 admin admin] PATH_INFO: `/v3/projects/e6a5f874558a4176869d3b314711b4d6/users/4c0fbff2e80441b78765349658b2940e/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:13.564326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f29b41-371a-4ff1-8c42-ebf3d3485487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a5f874558a4176869d3b314711b4d6, user_id=4c0fbff2e80441b78765349658b2940e, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:13.570783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f29b41-371a-4ff1-8c42-ebf3d3485487 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:13.607800 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 886/1767] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:13 2022] PUT /identity/v3/projects/e6a5f874558a4176869d3b314711b4d6/users/4c0fbff2e80441b78765349658b2940e/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:13.613184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341d9e-2162-44c7-a16c-9b5450289a33 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:13.614027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341d9e-2162-44c7-a16c-9b5450289a33 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:13.614524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1341d9e-2162-44c7-a16c-9b5450289a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:13.665347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-d1341d9e-2162-44c7-a16c-9b5450289a33 None None] MFA Rules not processed for user `4c0fbff2e80441b78765349658b2940e`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:13.671442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d1341d9e-2162-44c7-a16c-9b5450289a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:13.775143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 882/1768] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:13.789792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f29b41-371a-4ff1-8c42-ebf3d3485487 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:13.791768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e2f29b41-371a-4ff1-8c42-ebf3d3485487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:13.844308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1341d9e-2162-44c7-a16c-9b5450289a33 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:13.845985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d1341d9e-2162-44c7-a16c-9b5450289a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:13.888844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:13.976825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f29b41-371a-4ff1-8c42-ebf3d3485487 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:13.988297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5156ab-3105-43fe-8f27-e6d145a47621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:13.988920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5156ab-3105-43fe-8f27-e6d145a47621 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:13.991087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5156ab-3105-43fe-8f27-e6d145a47621 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:13.991387 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5156ab-3105-43fe-8f27-e6d145a47621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:14.017263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1341d9e-2162-44c7-a16c-9b5450289a33 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:14.038469 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:14.039367 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:14.044387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:14.044870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] PATH_INFO: `/v3/projects/9fa8cdb01fee46e7902b6e40b6138139` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:14.062745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa8cdb01fee46e7902b6e40b6138139)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:14.065886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:14.137338 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5156ab-3105-43fe-8f27-e6d145a47621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:14.139725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5156ab-3105-43fe-8f27-e6d145a47621 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:14.166702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 887/1769] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:14.281405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa8cdb01fee46e7902b6e40b6138139', 'request_id': 'req-f5acc468-7b92-4f26-af17-e38d4fab990c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:14.369726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa8cdb01fee46e7902b6e40b6138139', 'request_id': 'req-f5acc468-7b92-4f26-af17-e38d4fab990c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:14.373381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:14.377749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa8cdb01fee46e7902b6e40b6138139', 'request_id': 'req-f5acc468-7b92-4f26-af17-e38d4fab990c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:14.404115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] The token cache is being invalidate because project 9fa8cdb01fee46e7902b6e40b6138139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:14.411741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:14.411741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:14.411741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 883/1770] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:13 2022] DELETE /identity/v3/projects/9fa8cdb01fee46e7902b6e40b6138139 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:14.415079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5156ab-3105-43fe-8f27-e6d145a47621 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:14.428951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5156ab-3105-43fe-8f27-e6d145a47621 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:14.536146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:14.550118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c350b-9bea-4ce4-bcf2-0759415dc2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:14.551319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c350b-9bea-4ce4-bcf2-0759415dc2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:14.552444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c350b-9bea-4ce4-bcf2-0759415dc2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:14.554556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c350b-9bea-4ce4-bcf2-0759415dc2a7 admin admin] PATH_INFO: `/v3/users/ad3e865df66b4acb84ae68bd0177eff3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:14.557196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c350b-9bea-4ce4-bcf2-0759415dc2a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad3e865df66b4acb84ae68bd0177eff3)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:14.558782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c350b-9bea-4ce4-bcf2-0759415dc2a7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:14.864264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-007c350b-9bea-4ce4-bcf2-0759415dc2a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad3e865df66b4acb84ae68bd0177eff3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:14.960145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-007c350b-9bea-4ce4-bcf2-0759415dc2a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad3e865df66b4acb84ae68bd0177eff3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:15.024819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-007c350b-9bea-4ce4-bcf2-0759415dc2a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad3e865df66b4acb84ae68bd0177eff3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:15.026439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-007c350b-9bea-4ce4-bcf2-0759415dc2a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad3e865df66b4acb84ae68bd0177eff3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:15.028672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-007c350b-9bea-4ce4-bcf2-0759415dc2a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad3e865df66b4acb84ae68bd0177eff3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:15.067497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 888/1771] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:14 2022] DELETE /identity/v3/users/ad3e865df66b4acb84ae68bd0177eff3 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:17.257290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:17.257290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:17.271347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acc468-7b92-4f26-af17-e38d4fab990c admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:17.430336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:17.431249 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:17.431533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:17.431837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] PATH_INFO: `/v3/projects/af3b7beeada34f2eac10e0eaf2099cca` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:17.433076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3b7beeada34f2eac10e0eaf2099cca)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:17.435080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:18.103617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451da6d-9d98-410b-b464-3017b7e9d9e7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:18.104124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451da6d-9d98-410b-b464-3017b7e9d9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:18.104208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451da6d-9d98-410b-b464-3017b7e9d9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:18.122028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b451da6d-9d98-410b-b464-3017b7e9d9e7 None None] MFA Rules not processed for user `b8ee3e13db3746d69529e75537b1cb66`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:18.123727 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b451da6d-9d98-410b-b464-3017b7e9d9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:18.189793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 889/1772] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:18.213707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3b7beeada34f2eac10e0eaf2099cca', 'request_id': 'req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:18.418769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3b7beeada34f2eac10e0eaf2099cca', 'request_id': 'req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:18.435918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8f0e-7a77-4f89-a6b2-4f4b2ffc0af7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:18.436516 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8f0e-7a77-4f89-a6b2-4f4b2ffc0af7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:18.436998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8f0e-7a77-4f89-a6b2-4f4b2ffc0af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:18.443011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3b7beeada34f2eac10e0eaf2099cca', 'request_id': 'req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:18.454690 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:18.463357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ecbf8f0e-7a77-4f89-a6b2-4f4b2ffc0af7 None None] MFA Rules not processed for user `c7704f30352a4b7b8b8ee9019d86f50a`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:18.465275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ecbf8f0e-7a77-4f89-a6b2-4f4b2ffc0af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:18.479489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] The token cache is being invalidate because project af3b7beeada34f2eac10e0eaf2099cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:18.479824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:18.482610 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-96c03d2f-78b2-49f3-9eed-9ca8cc74f645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:18.484203 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:18.491489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 884/1773] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:17 2022] DELETE /identity/v3/projects/af3b7beeada34f2eac10e0eaf2099cca => generated 0 bytes in 1240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:18.506914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9476a-d628-46d8-8ac3-8a3fa26a5b8a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:18.507309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9476a-d628-46d8-8ac3-8a3fa26a5b8a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:18.507612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9476a-d628-46d8-8ac3-8a3fa26a5b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:18.547679 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b9b9476a-d628-46d8-8ac3-8a3fa26a5b8a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:18.549174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b9b9476a-d628-46d8-8ac3-8a3fa26a5b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:18.639263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 890/1774] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:18.656455 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 885/1775] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:18.676474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45567518-4bc6-44cc-bcf0-bdf05440ac37 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:18.676771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45567518-4bc6-44cc-bcf0-bdf05440ac37 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:18.677056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45567518-4bc6-44cc-bcf0-bdf05440ac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:18.733572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-45567518-4bc6-44cc-bcf0-bdf05440ac37 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:18.734912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-45567518-4bc6-44cc-bcf0-bdf05440ac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:18.749582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 891/1776] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:18.753812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9476a-d628-46d8-8ac3-8a3fa26a5b8a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:18.770062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9476a-d628-46d8-8ac3-8a3fa26a5b8a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:18.788578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073411c-d131-41e7-a505-2e0563ddbb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:18.788578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073411c-d131-41e7-a505-2e0563ddbb87 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:18.788578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073411c-d131-41e7-a505-2e0563ddbb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:18.788578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073411c-d131-41e7-a505-2e0563ddbb87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:18.788967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073411c-d131-41e7-a505-2e0563ddbb87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:18.788967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073411c-d131-41e7-a505-2e0563ddbb87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:18.798508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073411c-d131-41e7-a505-2e0563ddbb87 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:18.821587 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 886/1777] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:18.822185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45567518-4bc6-44cc-bcf0-bdf05440ac37 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:18.862589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45567518-4bc6-44cc-bcf0-bdf05440ac37 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:18.883427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fee7b-7fd9-4909-8b19-ca16b661cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:18.884225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fee7b-7fd9-4909-8b19-ca16b661cbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:18.884603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fee7b-7fd9-4909-8b19-ca16b661cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:18.885226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fee7b-7fd9-4909-8b19-ca16b661cbc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:18.886026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fee7b-7fd9-4909-8b19-ca16b661cbc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:18.889073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fee7b-7fd9-4909-8b19-ca16b661cbc7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:19.007833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 892/1778] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:18 2022] POST /identity/v3/projects => generated 407 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:19.011878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073411c-d131-41e7-a505-2e0563ddbb87 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:19.028733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073411c-d131-41e7-a505-2e0563ddbb87 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:19.048095 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fee7b-7fd9-4909-8b19-ca16b661cbc7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:19.050002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a06fee7b-7fd9-4909-8b19-ca16b661cbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:19.178031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fee7b-7fd9-4909-8b19-ca16b661cbc7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:19.185846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790f8dc-b752-442d-a109-ed2ba3c0ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:19.187907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790f8dc-b752-442d-a109-ed2ba3c0ba21 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:19.188564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790f8dc-b752-442d-a109-ed2ba3c0ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:19.190971 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790f8dc-b752-442d-a109-ed2ba3c0ba21 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:19.191599 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626be809-803c-4821-aff2-be5e9c78e913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:19.192714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790f8dc-b752-442d-a109-ed2ba3c0ba21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:19.193594 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be809-803c-4821-aff2-be5e9c78e913 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:19.195926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be809-803c-4821-aff2-be5e9c78e913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:19.196612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be809-803c-4821-aff2-be5e9c78e913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:19.198176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790f8dc-b752-442d-a109-ed2ba3c0ba21 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:19.202400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-626be809-803c-4821-aff2-be5e9c78e913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:19.310638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 887/1779] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:19 2022] POST /identity/v3/users => generated 304 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:19.311735 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790f8dc-b752-442d-a109-ed2ba3c0ba21 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:19.348846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790f8dc-b752-442d-a109-ed2ba3c0ba21 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:19.360817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94f1b7-edc6-4e78-aaf1-6d206c2de67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:19.361509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f1b7-edc6-4e78-aaf1-6d206c2de67a admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:19.361960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f1b7-edc6-4e78-aaf1-6d206c2de67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:19.362173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94f1b7-edc6-4e78-aaf1-6d206c2de67a admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:19.362863 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94f1b7-edc6-4e78-aaf1-6d206c2de67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:19.364524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94f1b7-edc6-4e78-aaf1-6d206c2de67a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:19.386285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626be809-803c-4821-aff2-be5e9c78e913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:19.393100 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 888/1780] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:19.394214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626be809-803c-4821-aff2-be5e9c78e913 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:19.396935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94f1b7-edc6-4e78-aaf1-6d206c2de67a admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:19.414921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94f1b7-edc6-4e78-aaf1-6d206c2de67a admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:19.418547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 893/1781] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:19.431164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d9865-7178-4442-9cb3-b7bbf6debda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:19.431882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d9865-7178-4442-9cb3-b7bbf6debda4 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:19.432169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d9865-7178-4442-9cb3-b7bbf6debda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:19.432652 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d9865-7178-4442-9cb3-b7bbf6debda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:19.433401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d9865-7178-4442-9cb3-b7bbf6debda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:19.435563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d9865-7178-4442-9cb3-b7bbf6debda4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:19.478541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626be809-803c-4821-aff2-be5e9c78e913 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:19.482521 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 889/1782] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:19.497321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626be809-803c-4821-aff2-be5e9c78e913 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:19.510382 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b25a77-7ebc-41e2-a895-80ec1e305b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:19.511546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b25a77-7ebc-41e2-a895-80ec1e305b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:19.512647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b25a77-7ebc-41e2-a895-80ec1e305b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:19.513277 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b25a77-7ebc-41e2-a895-80ec1e305b69 admin admin] PATH_INFO: `/v3/projects/7b620ded5b9741b0abb000ac132d19ca/users/bf598526645f4109a5a0461540ca4e0d/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:19.537153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b25a77-7ebc-41e2-a895-80ec1e305b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b620ded5b9741b0abb000ac132d19ca, user_id=bf598526645f4109a5a0461540ca4e0d, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:19.540375 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b25a77-7ebc-41e2-a895-80ec1e305b69 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:19.633890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 894/1783] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:19 2022] PUT /identity/v3/projects/7b620ded5b9741b0abb000ac132d19ca/users/bf598526645f4109a5a0461540ca4e0d/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:19.645415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1c9e1-9750-4240-96b8-7cd37dc17e10 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:19.645700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1c9e1-9750-4240-96b8-7cd37dc17e10 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:19.646264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1c9e1-9750-4240-96b8-7cd37dc17e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:19.705575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-93b1c9e1-9750-4240-96b8-7cd37dc17e10 None None] MFA Rules not processed for user `bf598526645f4109a5a0461540ca4e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:19.707131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-93b1c9e1-9750-4240-96b8-7cd37dc17e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:19.852404 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 890/1784] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:19.856677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b25a77-7ebc-41e2-a895-80ec1e305b69 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:20.031460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b25a77-7ebc-41e2-a895-80ec1e305b69 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:20.045414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72a10-7a5b-48c4-ab5d-456ee01428b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:20.046864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72a10-7a5b-48c4-ab5d-456ee01428b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:20.047506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72a10-7a5b-48c4-ab5d-456ee01428b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:20.047956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72a10-7a5b-48c4-ab5d-456ee01428b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:20.048840 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed72a10-7a5b-48c4-ab5d-456ee01428b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:20.051192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed72a10-7a5b-48c4-ab5d-456ee01428b6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:20.159435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6877f67-5bca-44d6-9eba-723707f8a2ae None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:20.163639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6877f67-5bca-44d6-9eba-723707f8a2ae None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:20.163639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6877f67-5bca-44d6-9eba-723707f8a2ae None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:20.163639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 891/1785] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:20.174590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ab78-d199-4bba-8368-6aea33a1dd00 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:20.174758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ab78-d199-4bba-8368-6aea33a1dd00 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:20.175213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302ab78-d199-4bba-8368-6aea33a1dd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:20.198793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 895/1786] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:19 2022] POST /identity/v3/projects => generated 409 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:20.201200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72a10-7a5b-48c4-ab5d-456ee01428b6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:20.237326 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c302ab78-d199-4bba-8368-6aea33a1dd00 None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:20.238235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c302ab78-d199-4bba-8368-6aea33a1dd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:20.376635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed72a10-7a5b-48c4-ab5d-456ee01428b6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:20.396548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f7068-27ff-4ea9-9a96-45e12d460fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:20.397250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f7068-27ff-4ea9-9a96-45e12d460fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:20.397540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f7068-27ff-4ea9-9a96-45e12d460fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:20.397828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f7068-27ff-4ea9-9a96-45e12d460fb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:20.398557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f7068-27ff-4ea9-9a96-45e12d460fb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:20.400553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f7068-27ff-4ea9-9a96-45e12d460fb2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:20.443930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 892/1787] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:13:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:20.513103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 896/1788] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:20 2022] POST /identity/v3/users => generated 311 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:20.517134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ab78-d199-4bba-8368-6aea33a1dd00 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:20.539360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302ab78-d199-4bba-8368-6aea33a1dd00 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:20.559079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c18e08-05d5-4f37-9dd5-bc104afbaab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:20.559825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18e08-05d5-4f37-9dd5-bc104afbaab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:20.560106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18e08-05d5-4f37-9dd5-bc104afbaab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:20.560392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c18e08-05d5-4f37-9dd5-bc104afbaab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:20.561146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18e08-05d5-4f37-9dd5-bc104afbaab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:20.566247 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c18e08-05d5-4f37-9dd5-bc104afbaab3 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:20.594903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 893/1789] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:20.596191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f7068-27ff-4ea9-9a96-45e12d460fb2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:20.618083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f7068-27ff-4ea9-9a96-45e12d460fb2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:20.634460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edaaec-ea32-41d4-b267-9548805445ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:20.635667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edaaec-ea32-41d4-b267-9548805445ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:20.635968 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edaaec-ea32-41d4-b267-9548805445ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:20.636255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edaaec-ea32-41d4-b267-9548805445ce admin admin] PATH_INFO: `/v3/projects/7f0d545574fb4dd381ab92c2f18da971/users/ec7dde7701eb44179005d6f97fb2a8bc/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:20.691837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edaaec-ea32-41d4-b267-9548805445ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0d545574fb4dd381ab92c2f18da971, user_id=ec7dde7701eb44179005d6f97fb2a8bc, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:20.694636 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89edaaec-ea32-41d4-b267-9548805445ce admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:20.859265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 897/1790] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:20 2022] PUT /identity/v3/projects/7f0d545574fb4dd381ab92c2f18da971/users/ec7dde7701eb44179005d6f97fb2a8bc/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:20.863017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c18e08-05d5-4f37-9dd5-bc104afbaab3 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:20.881788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c18e08-05d5-4f37-9dd5-bc104afbaab3 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:21.002963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df636655-3bb9-45a1-b0c7-e0e10f4ab59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:21.003965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df636655-3bb9-45a1-b0c7-e0e10f4ab59c admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.004420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df636655-3bb9-45a1-b0c7-e0e10f4ab59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.004909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df636655-3bb9-45a1-b0c7-e0e10f4ab59c admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.005855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df636655-3bb9-45a1-b0c7-e0e10f4ab59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:21.007892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df636655-3bb9-45a1-b0c7-e0e10f4ab59c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:21.018781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 894/1791] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:21.023091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edaaec-ea32-41d4-b267-9548805445ce admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:21.037668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edaaec-ea32-41d4-b267-9548805445ce admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:21.051119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f56ea-4488-41ad-9a49-6742afbcac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:21.052236 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f56ea-4488-41ad-9a49-6742afbcac92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.053583 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f56ea-4488-41ad-9a49-6742afbcac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.054049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f56ea-4488-41ad-9a49-6742afbcac92 admin admin] PATH_INFO: `/v3/projects/7f0d545574fb4dd381ab92c2f18da971/users/ec7dde7701eb44179005d6f97fb2a8bc/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.057081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f56ea-4488-41ad-9a49-6742afbcac92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0d545574fb4dd381ab92c2f18da971, user_id=ec7dde7701eb44179005d6f97fb2a8bc, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:21.061614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f56ea-4488-41ad-9a49-6742afbcac92 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:21.074121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 898/1792] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:21 2022] PUT /identity/v3/projects/7f0d545574fb4dd381ab92c2f18da971/users/ec7dde7701eb44179005d6f97fb2a8bc/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:21.086503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ec589-5865-4fa3-a730-e00b16a4107c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.087667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ec589-5865-4fa3-a730-e00b16a4107c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.088095 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ec589-5865-4fa3-a730-e00b16a4107c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.135943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-599ec589-5865-4fa3-a730-e00b16a4107c None None] MFA Rules not processed for user `ec7dde7701eb44179005d6f97fb2a8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:21.138697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-599ec589-5865-4fa3-a730-e00b16a4107c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:21.231333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 895/1793] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:21.243758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f56ea-4488-41ad-9a49-6742afbcac92 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:21.265547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6cd7f-3cae-4cdb-9bd8-c08923e464a4 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.265849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6cd7f-3cae-4cdb-9bd8-c08923e464a4 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.266134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6cd7f-3cae-4cdb-9bd8-c08923e464a4 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.267876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 896/1794] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:21.276769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab264-8362-429b-9f17-23635ecead3c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.277215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab264-8362-429b-9f17-23635ecead3c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.279047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cab264-8362-429b-9f17-23635ecead3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.306009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a0cab264-8362-429b-9f17-23635ecead3c None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:21.307246 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a0cab264-8362-429b-9f17-23635ecead3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:21.318553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f56ea-4488-41ad-9a49-6742afbcac92 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:21.324645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0b2c-b994-4162-8d08-b8de9cc0af3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:21.327030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0b2c-b994-4162-8d08-b8de9cc0af3d service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.327368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0b2c-b994-4162-8d08-b8de9cc0af3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.327857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb0b2c-b994-4162-8d08-b8de9cc0af3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.340054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb0b2c-b994-4162-8d08-b8de9cc0af3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:21.341706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb0b2c-b994-4162-8d08-b8de9cc0af3d service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:21.358804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 899/1795] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:21 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:21.389771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0b2c-b994-4162-8d08-b8de9cc0af3d service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:21.391378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-eeeb0b2c-b994-4162-8d08-b8de9cc0af3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:21.455754 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 897/1796] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:21.575780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:21.580399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb0b2c-b994-4162-8d08-b8de9cc0af3d service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:21.583179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cab264-8362-429b-9f17-23635ecead3c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:21.586250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a0cab264-8362-429b-9f17-23635ecead3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:21.597042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee743d31-dadf-4821-9f88-4c0a00f92d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:21.598214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee743d31-dadf-4821-9f88-4c0a00f92d4f service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.598686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee743d31-dadf-4821-9f88-4c0a00f92d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.599033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee743d31-dadf-4821-9f88-4c0a00f92d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.606364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cab264-8362-429b-9f17-23635ecead3c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:21.611396 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee743d31-dadf-4821-9f88-4c0a00f92d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:21.612887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73852c94-57a8-4753-832c-d7e08fc3df78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:21.613501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee743d31-dadf-4821-9f88-4c0a00f92d4f service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:21.613603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852c94-57a8-4753-832c-d7e08fc3df78 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:21.613882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852c94-57a8-4753-832c-d7e08fc3df78 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:21.614265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73852c94-57a8-4753-832c-d7e08fc3df78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:21.629501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:21.629658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 900/1797] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:21.641561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73852c94-57a8-4753-832c-d7e08fc3df78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:21.643551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73852c94-57a8-4753-832c-d7e08fc3df78 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:21.656919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 898/1798] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:21.990388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee743d31-dadf-4821-9f88-4c0a00f92d4f service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:22.006707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee743d31-dadf-4821-9f88-4c0a00f92d4f service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:22.026425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a436243-e162-4888-a633-0ba910bae28f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:22.027089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a436243-e162-4888-a633-0ba910bae28f service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:22.027437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a436243-e162-4888-a633-0ba910bae28f service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:22.028354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a436243-e162-4888-a633-0ba910bae28f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:22.175444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a436243-e162-4888-a633-0ba910bae28f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:22.182569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a436243-e162-4888-a633-0ba910bae28f service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:22.219618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 901/1799] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:21 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:23.298137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:23.874025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:28.027461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73852c94-57a8-4753-832c-d7e08fc3df78 service nova] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:28.029224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-73852c94-57a8-4753-832c-d7e08fc3df78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:28.126526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73852c94-57a8-4753-832c-d7e08fc3df78 service nova] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:28.135771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:28.137020 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:28.137468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:28.138230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] PATH_INFO: `/v3/users/569d9ab821094b90900adedb6dd62a0f` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:28.139798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=569d9ab821094b90900adedb6dd62a0f)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:28.141749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:28.358437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569d9ab821094b90900adedb6dd62a0f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:28.375772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:28.387040 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569d9ab821094b90900adedb6dd62a0f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:28.390819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569d9ab821094b90900adedb6dd62a0f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:28.404212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569d9ab821094b90900adedb6dd62a0f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:28.405042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569d9ab821094b90900adedb6dd62a0f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:28.497080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 899/1800] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:28 2022] DELETE /identity/v3/users/569d9ab821094b90900adedb6dd62a0f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:28.503040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791a361-6e86-44c9-9265-6eec706affdd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:28.503626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791a361-6e86-44c9-9265-6eec706affdd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:28.503992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791a361-6e86-44c9-9265-6eec706affdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:28.532914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7791a361-6e86-44c9-9265-6eec706affdd None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:28.534255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7791a361-6e86-44c9-9265-6eec706affdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:28.606928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 902/1801] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:28.619869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:28.620639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:28.684932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ac148-320b-4729-8851-14e15fda7bc1 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:28.692822 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0328f-4a5e-4e6a-9371-6cf4998500bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:28.693806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0328f-4a5e-4e6a-9371-6cf4998500bc service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:28.694024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0328f-4a5e-4e6a-9371-6cf4998500bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:28.694451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0328f-4a5e-4e6a-9371-6cf4998500bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:28.710864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0328f-4a5e-4e6a-9371-6cf4998500bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:28.711844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0328f-4a5e-4e6a-9371-6cf4998500bc service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:28.727770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 900/1802] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:29.260642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791a361-6e86-44c9-9265-6eec706affdd None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:29.263279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7791a361-6e86-44c9-9265-6eec706affdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:29.284897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791a361-6e86-44c9-9265-6eec706affdd None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:29.291738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:29.293512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:29.294034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:29.294519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] PATH_INFO: `/v3/projects/7cf5831dfab64027b4d34ad6ed277130` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:29.297094 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf5831dfab64027b4d34ad6ed277130)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:29.300729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:29.365680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:29.499801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf5831dfab64027b4d34ad6ed277130', 'request_id': 'req-53fd7989-7604-4697-96d4-c0223db51965'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:29.508414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf5831dfab64027b4d34ad6ed277130', 'request_id': 'req-53fd7989-7604-4697-96d4-c0223db51965'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:29.520390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf5831dfab64027b4d34ad6ed277130', 'request_id': 'req-53fd7989-7604-4697-96d4-c0223db51965'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:29.657985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] The token cache is being invalidate because project 7cf5831dfab64027b4d34ad6ed277130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:29.658651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:29.659755 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:29.661549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 903/1803] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:29 2022] DELETE /identity/v3/projects/7cf5831dfab64027b4d34ad6ed277130 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:29.666787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0328f-4a5e-4e6a-9371-6cf4998500bc service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:29.679874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0328f-4a5e-4e6a-9371-6cf4998500bc service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:29.766183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:29.767074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:29.767426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:29.767782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] PATH_INFO: `/v3/users/0f3c2da330d04b70b9803ae53113ff79` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:29.769043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3c2da330d04b70b9803ae53113ff79)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:29.770995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:30.017677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3c2da330d04b70b9803ae53113ff79'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:30.050726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3c2da330d04b70b9803ae53113ff79'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:30.051662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3c2da330d04b70b9803ae53113ff79'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:30.065382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3c2da330d04b70b9803ae53113ff79'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:30.066559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3c2da330d04b70b9803ae53113ff79'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:30.164249 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:30.172345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 901/1804] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:29 2022] DELETE /identity/v3/users/0f3c2da330d04b70b9803ae53113ff79 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:30.794681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:30.796121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:30.809536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd7989-7604-4697-96d4-c0223db51965 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:30.836199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:30.837862 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:30.882541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d2122-fa35-4d63-9120-339b474c7088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:30.883551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d2122-fa35-4d63-9120-339b474c7088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:30.883945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d2122-fa35-4d63-9120-339b474c7088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:30.884297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d2122-fa35-4d63-9120-339b474c7088 admin admin] PATH_INFO: `/v3/users/bf598526645f4109a5a0461540ca4e0d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:30.885860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d2122-fa35-4d63-9120-339b474c7088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf598526645f4109a5a0461540ca4e0d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:30.891083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d2122-fa35-4d63-9120-339b474c7088 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:30.926630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1e03c-8a03-4ee9-9e77-85d3bc6ab905 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:30.932401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:30.933475 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:30.933827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:30.934183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] PATH_INFO: `/v3/projects/e93b8babffe64b89a39dcd99562f42b8` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:30.935454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93b8babffe64b89a39dcd99562f42b8)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:30.937437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:31.085270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93b8babffe64b89a39dcd99562f42b8', 'request_id': 'req-f14d5731-dab7-403e-b375-2c2ea414928a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.086084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7b6d2122-fa35-4d63-9120-339b474c7088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf598526645f4109a5a0461540ca4e0d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.146482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93b8babffe64b89a39dcd99562f42b8', 'request_id': 'req-f14d5731-dab7-403e-b375-2c2ea414928a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.153532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93b8babffe64b89a39dcd99562f42b8', 'request_id': 'req-f14d5731-dab7-403e-b375-2c2ea414928a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.163772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] The token cache is being invalidate because project e93b8babffe64b89a39dcd99562f42b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:31.164064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.164690 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f14d5731-dab7-403e-b375-2c2ea414928a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.166224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 902/1805] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:30 2022] DELETE /identity/v3/projects/e93b8babffe64b89a39dcd99562f42b8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:31.171375 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5846ef-876a-41d0-8e4c-8801ffc0d9d1 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.171696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5846ef-876a-41d0-8e4c-8801ffc0d9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.171980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5846ef-876a-41d0-8e4c-8801ffc0d9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.189698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-1b5846ef-876a-41d0-8e4c-8801ffc0d9d1 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:31.190887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1b5846ef-876a-41d0-8e4c-8801ffc0d9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:31.233767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7b6d2122-fa35-4d63-9120-339b474c7088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf598526645f4109a5a0461540ca4e0d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.250317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7b6d2122-fa35-4d63-9120-339b474c7088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf598526645f4109a5a0461540ca4e0d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.251259 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7b6d2122-fa35-4d63-9120-339b474c7088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf598526645f4109a5a0461540ca4e0d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.252284 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7b6d2122-fa35-4d63-9120-339b474c7088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf598526645f4109a5a0461540ca4e0d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:31.262001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 903/1806] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:31.264289 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36977b50-6a90-4a0e-a94f-4d3094e5867c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.264745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36977b50-6a90-4a0e-a94f-4d3094e5867c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.265163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36977b50-6a90-4a0e-a94f-4d3094e5867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.275041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 904/1807] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:30 2022] DELETE /identity/v3/users/bf598526645f4109a5a0461540ca4e0d => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:31.280083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1869a2b-f919-4a95-a7fe-d263c37b1136 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.280380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1869a2b-f919-4a95-a7fe-d263c37b1136 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.280665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1869a2b-f919-4a95-a7fe-d263c37b1136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.288217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-36977b50-6a90-4a0e-a94f-4d3094e5867c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:31.289640 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-36977b50-6a90-4a0e-a94f-4d3094e5867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:31.297946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f1869a2b-f919-4a95-a7fe-d263c37b1136 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:31.299137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f1869a2b-f919-4a95-a7fe-d263c37b1136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:31.323053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:31.369081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 905/1808] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:31.372013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 904/1809] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:31.373233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1869a2b-f919-4a95-a7fe-d263c37b1136 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:31.376012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36977b50-6a90-4a0e-a94f-4d3094e5867c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:31.384556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-36977b50-6a90-4a0e-a94f-4d3094e5867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:31.386907 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1869a2b-f919-4a95-a7fe-d263c37b1136 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:31.395403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a5dc8-ab90-4aa4-8252-f9e6772a835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:31.395403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a5dc8-ab90-4aa4-8252-f9e6772a835f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.395403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a5dc8-ab90-4aa4-8252-f9e6772a835f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.395403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a5dc8-ab90-4aa4-8252-f9e6772a835f admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.396485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a5dc8-ab90-4aa4-8252-f9e6772a835f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:31.396485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a5dc8-ab90-4aa4-8252-f9e6772a835f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:31.398492 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a5dc8-ab90-4aa4-8252-f9e6772a835f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:31.416004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 906/1810] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:31.420054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a5dc8-ab90-4aa4-8252-f9e6772a835f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:31.434822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a5dc8-ab90-4aa4-8252-f9e6772a835f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:31.440693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae3c48-71cb-466e-86bb-68799a29d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:31.441365 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae3c48-71cb-466e-86bb-68799a29d85a admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.441658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae3c48-71cb-466e-86bb-68799a29d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.441942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae3c48-71cb-466e-86bb-68799a29d85a admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.442670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae3c48-71cb-466e-86bb-68799a29d85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:31.444676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae3c48-71cb-466e-86bb-68799a29d85a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:31.450841 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36977b50-6a90-4a0e-a94f-4d3094e5867c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:31.454550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c91d5b-b7ec-4fc0-b6e1-0f430076ee40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:31.455193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c91d5b-b7ec-4fc0-b6e1-0f430076ee40 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.455879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c91d5b-b7ec-4fc0-b6e1-0f430076ee40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.456049 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c91d5b-b7ec-4fc0-b6e1-0f430076ee40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.467458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c91d5b-b7ec-4fc0-b6e1-0f430076ee40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:31.469012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c91d5b-b7ec-4fc0-b6e1-0f430076ee40 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:31.479009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 905/1811] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:31.568543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 907/1812] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:31 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:31.574733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c91d5b-b7ec-4fc0-b6e1-0f430076ee40 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:31.587310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c91d5b-b7ec-4fc0-b6e1-0f430076ee40 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:31.646308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124e7f8-a1ff-4ad6-8709-fdb4ff3e27db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:31.646991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124e7f8-a1ff-4ad6-8709-fdb4ff3e27db admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.647281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124e7f8-a1ff-4ad6-8709-fdb4ff3e27db admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.647564 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124e7f8-a1ff-4ad6-8709-fdb4ff3e27db admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.648290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124e7f8-a1ff-4ad6-8709-fdb4ff3e27db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:31.650285 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124e7f8-a1ff-4ad6-8709-fdb4ff3e27db admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:31.734431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 906/1813] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:31 2022] POST /identity/v3/users => generated 285 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:31.735765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae3c48-71cb-466e-86bb-68799a29d85a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:31.755847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae3c48-71cb-466e-86bb-68799a29d85a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:31.764209 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa483a-b2b5-47b3-a99b-4a6469d257fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:31.764967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa483a-b2b5-47b3-a99b-4a6469d257fc admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.765332 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa483a-b2b5-47b3-a99b-4a6469d257fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.765703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa483a-b2b5-47b3-a99b-4a6469d257fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.766561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa483a-b2b5-47b3-a99b-4a6469d257fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:31.768372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa483a-b2b5-47b3-a99b-4a6469d257fc admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:31.780490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 908/1814] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:31.784429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124e7f8-a1ff-4ad6-8709-fdb4ff3e27db admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:31.796255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124e7f8-a1ff-4ad6-8709-fdb4ff3e27db admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:31.801730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf241b6-f247-4a9f-908d-a0d4159bbc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:31.802488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf241b6-f247-4a9f-908d-a0d4159bbc20 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.802773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf241b6-f247-4a9f-908d-a0d4159bbc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.803172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf241b6-f247-4a9f-908d-a0d4159bbc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.804072 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf241b6-f247-4a9f-908d-a0d4159bbc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:31.805807 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf241b6-f247-4a9f-908d-a0d4159bbc20 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:31.820859 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 907/1815] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:31.826212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa483a-b2b5-47b3-a99b-4a6469d257fc admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:31.838916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa483a-b2b5-47b3-a99b-4a6469d257fc admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:31.845937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b940e0-efec-434e-9b97-00f6addfa1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:31.847031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b940e0-efec-434e-9b97-00f6addfa1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.847318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b940e0-efec-434e-9b97-00f6addfa1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.849307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b940e0-efec-434e-9b97-00f6addfa1a9 admin admin] PATH_INFO: `/v3/projects/dbb25a1202c0457aa0e2fd6cd4fe087b/users/b9f11d96ad5c4560b12205638cd9239f/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.863663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b940e0-efec-434e-9b97-00f6addfa1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb25a1202c0457aa0e2fd6cd4fe087b, user_id=b9f11d96ad5c4560b12205638cd9239f, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:31.866333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b940e0-efec-434e-9b97-00f6addfa1a9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:31.945098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 909/1816] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:31 2022] PUT /identity/v3/projects/dbb25a1202c0457aa0e2fd6cd4fe087b/users/b9f11d96ad5c4560b12205638cd9239f/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:31.957355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233d216-07c3-4a8b-8692-6fbc57f52224 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:31.957806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233d216-07c3-4a8b-8692-6fbc57f52224 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:31.957999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233d216-07c3-4a8b-8692-6fbc57f52224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:31.986230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5233d216-07c3-4a8b-8692-6fbc57f52224 None None] MFA Rules not processed for user `b9f11d96ad5c4560b12205638cd9239f`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:31.987496 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5233d216-07c3-4a8b-8692-6fbc57f52224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:32.025674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b940e0-efec-434e-9b97-00f6addfa1a9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:32.028636 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a1b940e0-efec-434e-9b97-00f6addfa1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:32.063930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 908/1817] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:32.067953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233d216-07c3-4a8b-8692-6fbc57f52224 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:32.122626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b940e0-efec-434e-9b97-00f6addfa1a9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:32.127505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:32.128408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:32.128687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:32.128958 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] PATH_INFO: `/v3/projects/7b620ded5b9741b0abb000ac132d19ca` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:32.130137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b620ded5b9741b0abb000ac132d19ca)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:32.130946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233d216-07c3-4a8b-8692-6fbc57f52224 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:32.132092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:32.136093 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaca13-a09d-4274-af31-89c30814fc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:32.137396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaca13-a09d-4274-af31-89c30814fc8b admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:32.137681 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaca13-a09d-4274-af31-89c30814fc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:32.137957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaca13-a09d-4274-af31-89c30814fc8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:32.138651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaca13-a09d-4274-af31-89c30814fc8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:32.140585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaca13-a09d-4274-af31-89c30814fc8b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:32.224506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 909/1818] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:32 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:32.228394 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaca13-a09d-4274-af31-89c30814fc8b admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:32.244833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b620ded5b9741b0abb000ac132d19ca', 'request_id': 'req-139b68b1-b596-467f-a1a3-fb61f03f9abd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:32.250829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b620ded5b9741b0abb000ac132d19ca', 'request_id': 'req-139b68b1-b596-467f-a1a3-fb61f03f9abd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:32.256996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b620ded5b9741b0abb000ac132d19ca', 'request_id': 'req-139b68b1-b596-467f-a1a3-fb61f03f9abd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:32.289661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaca13-a09d-4274-af31-89c30814fc8b admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:32.328237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] The token cache is being invalidate because project 7b620ded5b9741b0abb000ac132d19ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:32.328591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:32.329420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:32.331419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 910/1819] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:32 2022] DELETE /identity/v3/projects/7b620ded5b9741b0abb000ac132d19ca => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:32.341444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:32.344900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:32.372207 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128c20-60b3-4ddf-88af-4cbdc22ff4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:32.372892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128c20-60b3-4ddf-88af-4cbdc22ff4fb admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:32.373229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128c20-60b3-4ddf-88af-4cbdc22ff4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:32.373510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128c20-60b3-4ddf-88af-4cbdc22ff4fb admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:32.374271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128c20-60b3-4ddf-88af-4cbdc22ff4fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:32.376374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128c20-60b3-4ddf-88af-4cbdc22ff4fb admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:32.429817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b68b1-b596-467f-a1a3-fb61f03f9abd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:32.432549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0029d0-f242-4162-a967-f9241584e66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:32.433906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0029d0-f242-4162-a967-f9241584e66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:32.434123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0029d0-f242-4162-a967-f9241584e66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:32.434939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0029d0-f242-4162-a967-f9241584e66c admin admin] PATH_INFO: `/v3/users/ec7dde7701eb44179005d6f97fb2a8bc` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:32.436432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0029d0-f242-4162-a967-f9241584e66c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec7dde7701eb44179005d6f97fb2a8bc)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:32.438908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0029d0-f242-4162-a967-f9241584e66c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:32.498280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 910/1820] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:32 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:32.503334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128c20-60b3-4ddf-88af-4cbdc22ff4fb admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:32.506533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1a128c20-60b3-4ddf-88af-4cbdc22ff4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:32.527288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128c20-60b3-4ddf-88af-4cbdc22ff4fb admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:32.531430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f7749-ec43-4f66-ba03-70ef40d4aad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:32.532293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f7749-ec43-4f66-ba03-70ef40d4aad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:32.532708 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f7749-ec43-4f66-ba03-70ef40d4aad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:32.533166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f7749-ec43-4f66-ba03-70ef40d4aad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:32.534251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f7749-ec43-4f66-ba03-70ef40d4aad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:32.536452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f7749-ec43-4f66-ba03-70ef40d4aad3 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:32.548347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 911/1821] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:32.553254 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f7749-ec43-4f66-ba03-70ef40d4aad3 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:32.565657 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f7749-ec43-4f66-ba03-70ef40d4aad3 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:32.572099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62304e45-3f69-4779-8fae-cc73e11ea88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:32.573276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304e45-3f69-4779-8fae-cc73e11ea88d admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:32.574529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304e45-3f69-4779-8fae-cc73e11ea88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:32.574529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304e45-3f69-4779-8fae-cc73e11ea88d admin admin] PATH_INFO: `/v3/projects/12bee5ca9a194e5094b0d740cc15127d/users/b8970560e51a44bfbc932f5f9355a8b1/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:32.602723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62304e45-3f69-4779-8fae-cc73e11ea88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12bee5ca9a194e5094b0d740cc15127d, user_id=b8970560e51a44bfbc932f5f9355a8b1, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:32.607460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62304e45-3f69-4779-8fae-cc73e11ea88d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:32.669603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2d0029d0-f242-4162-a967-f9241584e66c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec7dde7701eb44179005d6f97fb2a8bc'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:32.689688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 912/1822] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:32 2022] PUT /identity/v3/projects/12bee5ca9a194e5094b0d740cc15127d/users/b8970560e51a44bfbc932f5f9355a8b1/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:32.694865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62304e45-3f69-4779-8fae-cc73e11ea88d admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:32.712943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:32.765567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62304e45-3f69-4779-8fae-cc73e11ea88d admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:32.770481 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b10fbe-bc13-4111-aebc-ae9873fd2497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:32.771233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b10fbe-bc13-4111-aebc-ae9873fd2497 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:32.771526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b10fbe-bc13-4111-aebc-ae9873fd2497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:32.771852 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b10fbe-bc13-4111-aebc-ae9873fd2497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:32.773071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b10fbe-bc13-4111-aebc-ae9873fd2497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:32.774300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b10fbe-bc13-4111-aebc-ae9873fd2497 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:32.779257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2d0029d0-f242-4162-a967-f9241584e66c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec7dde7701eb44179005d6f97fb2a8bc'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:32.787633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 913/1823] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:32.793393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b10fbe-bc13-4111-aebc-ae9873fd2497 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:32.802934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2d0029d0-f242-4162-a967-f9241584e66c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec7dde7701eb44179005d6f97fb2a8bc'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:32.804384 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2d0029d0-f242-4162-a967-f9241584e66c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec7dde7701eb44179005d6f97fb2a8bc'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:32.805192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2d0029d0-f242-4162-a967-f9241584e66c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec7dde7701eb44179005d6f97fb2a8bc'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:32.808682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b10fbe-bc13-4111-aebc-ae9873fd2497 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:32.815403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4421400-9fc4-497b-a3d3-cc59977cc2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:32.816348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4421400-9fc4-497b-a3d3-cc59977cc2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:32.816633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4421400-9fc4-497b-a3d3-cc59977cc2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:32.816964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4421400-9fc4-497b-a3d3-cc59977cc2ca admin admin] PATH_INFO: `/v3/projects/12bee5ca9a194e5094b0d740cc15127d/users/b8970560e51a44bfbc932f5f9355a8b1/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:32.819253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4421400-9fc4-497b-a3d3-cc59977cc2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=12bee5ca9a194e5094b0d740cc15127d, user_id=b8970560e51a44bfbc932f5f9355a8b1, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:32.822271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4421400-9fc4-497b-a3d3-cc59977cc2ca admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:32.824076 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 911/1824] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:32 2022] DELETE /identity/v3/users/ec7dde7701eb44179005d6f97fb2a8bc => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:32.853540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 914/1825] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:32 2022] PUT /identity/v3/projects/12bee5ca9a194e5094b0d740cc15127d/users/b8970560e51a44bfbc932f5f9355a8b1/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:32.866136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e273a-764c-4920-85e5-60e37de5edd7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:32.867213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e273a-764c-4920-85e5-60e37de5edd7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:32.868545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e273a-764c-4920-85e5-60e37de5edd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:32.899624 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-659e273a-764c-4920-85e5-60e37de5edd7 None None] MFA Rules not processed for user `b8970560e51a44bfbc932f5f9355a8b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:32.901010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-659e273a-764c-4920-85e5-60e37de5edd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:32.994967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 912/1826] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:33.008494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4421400-9fc4-497b-a3d3-cc59977cc2ca admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:33.019704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b4421400-9fc4-497b-a3d3-cc59977cc2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:33.093061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4421400-9fc4-497b-a3d3-cc59977cc2ca admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:33.097061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da071753-26e9-4079-b170-921dd2681d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:33.097939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da071753-26e9-4079-b170-921dd2681d75 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:33.098293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da071753-26e9-4079-b170-921dd2681d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:33.098636 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da071753-26e9-4079-b170-921dd2681d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:33.110138 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da071753-26e9-4079-b170-921dd2681d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:33.112459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da071753-26e9-4079-b170-921dd2681d75 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:33.127264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 915/1827] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:33.264340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e273a-764c-4920-85e5-60e37de5edd7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:33.266406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-659e273a-764c-4920-85e5-60e37de5edd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:33.281737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e273a-764c-4920-85e5-60e37de5edd7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:33.287924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a7069-43aa-4d83-bdd1-3ce48ca6c7ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:33.288642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7069-43aa-4d83-bdd1-3ce48ca6c7ef service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:33.288970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7069-43aa-4d83-bdd1-3ce48ca6c7ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:33.289194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a7069-43aa-4d83-bdd1-3ce48ca6c7ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:33.291004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6d2a7069-43aa-4d83-bdd1-3ce48ca6c7ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:33.363270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a7069-43aa-4d83-bdd1-3ce48ca6c7ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:33.365818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a7069-43aa-4d83-bdd1-3ce48ca6c7ef service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:33.376753 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 913/1828] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:34.204698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da071753-26e9-4079-b170-921dd2681d75 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:34.206328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-da071753-26e9-4079-b170-921dd2681d75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:34.240386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:34.324893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da071753-26e9-4079-b170-921dd2681d75 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:34.342758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:34.344109 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:34.344109 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:34.344460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] PATH_INFO: `/v3/projects/7f0d545574fb4dd381ab92c2f18da971` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:34.346901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0d545574fb4dd381ab92c2f18da971)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:34.349211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:34.486896 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0d545574fb4dd381ab92c2f18da971', 'request_id': 'req-6da8e95a-7e21-454a-bdd7-3d443177d160'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.595991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0d545574fb4dd381ab92c2f18da971', 'request_id': 'req-6da8e95a-7e21-454a-bdd7-3d443177d160'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.611637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0d545574fb4dd381ab92c2f18da971', 'request_id': 'req-6da8e95a-7e21-454a-bdd7-3d443177d160'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.624951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] The token cache is being invalidate because project 7f0d545574fb4dd381ab92c2f18da971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:34.625376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.626100 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6da8e95a-7e21-454a-bdd7-3d443177d160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:34.631202 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 916/1829] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:34 2022] DELETE /identity/v3/projects/7f0d545574fb4dd381ab92c2f18da971 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:34.637322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dfd66-c7cf-4a73-bae8-17b733fe3bb2 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:34.639503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dfd66-c7cf-4a73-bae8-17b733fe3bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:34.639503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dfd66-c7cf-4a73-bae8-17b733fe3bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:34.677442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c07dfd66-c7cf-4a73-bae8-17b733fe3bb2 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:34.678935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c07dfd66-c7cf-4a73-bae8-17b733fe3bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:34.781897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 914/1830] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:34.793720 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d8559-3dbd-4b70-b6d6-379cf2cf931a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:34.797352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d8559-3dbd-4b70-b6d6-379cf2cf931a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:34.797680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d8559-3dbd-4b70-b6d6-379cf2cf931a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:34.838519 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5f5d8559-3dbd-4b70-b6d6-379cf2cf931a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:34.840359 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5f5d8559-3dbd-4b70-b6d6-379cf2cf931a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:34.850465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 917/1831] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:34.854120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dfd66-c7cf-4a73-bae8-17b733fe3bb2 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:34.864914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dfd66-c7cf-4a73-bae8-17b733fe3bb2 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:34.869905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6ac0-f182-4936-b395-e68de2094e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:34.870798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6ac0-f182-4936-b395-e68de2094e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:34.871140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6ac0-f182-4936-b395-e68de2094e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:34.871575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6ac0-f182-4936-b395-e68de2094e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:34.872341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6ac0-f182-4936-b395-e68de2094e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:34.872648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6ac0-f182-4936-b395-e68de2094e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:34.874923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6ac0-f182-4936-b395-e68de2094e6f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:34.900405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 915/1832] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:34.903958 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d8559-3dbd-4b70-b6d6-379cf2cf931a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:34.921972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d8559-3dbd-4b70-b6d6-379cf2cf931a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:34.939391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73079e3-02e7-4eee-b764-3fc5b023d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:34.943799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73079e3-02e7-4eee-b764-3fc5b023d9ea admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:34.944597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73079e3-02e7-4eee-b764-3fc5b023d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:34.944996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73079e3-02e7-4eee-b764-3fc5b023d9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:34.945831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73079e3-02e7-4eee-b764-3fc5b023d9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:34.948203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73079e3-02e7-4eee-b764-3fc5b023d9ea admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.056327 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 918/1833] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:34 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:35.060894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6ac0-f182-4936-b395-e68de2094e6f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.071996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6ac0-f182-4936-b395-e68de2094e6f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.138748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51d329-1496-459c-a43b-c5d9fbc41c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.139432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d329-1496-459c-a43b-c5d9fbc41c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.139763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d329-1496-459c-a43b-c5d9fbc41c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.140178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d329-1496-459c-a43b-c5d9fbc41c79 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.140900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51d329-1496-459c-a43b-c5d9fbc41c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.142833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51d329-1496-459c-a43b-c5d9fbc41c79 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.273059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 916/1834] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:35 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:35.277538 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73079e3-02e7-4eee-b764-3fc5b023d9ea admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.298801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73079e3-02e7-4eee-b764-3fc5b023d9ea admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.305823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941b34-8250-46c0-9faa-8f5289013640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.306526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941b34-8250-46c0-9faa-8f5289013640 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.306811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941b34-8250-46c0-9faa-8f5289013640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.307085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941b34-8250-46c0-9faa-8f5289013640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.307893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941b34-8250-46c0-9faa-8f5289013640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.309490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941b34-8250-46c0-9faa-8f5289013640 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.320898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 919/1835] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:35.325577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51d329-1496-459c-a43b-c5d9fbc41c79 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.335860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51d329-1496-459c-a43b-c5d9fbc41c79 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.343294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0556ba-3ae5-4b39-b6c0-5e29d7e0b137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.344451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0556ba-3ae5-4b39-b6c0-5e29d7e0b137 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.344938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0556ba-3ae5-4b39-b6c0-5e29d7e0b137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.345428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0556ba-3ae5-4b39-b6c0-5e29d7e0b137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.346381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0556ba-3ae5-4b39-b6c0-5e29d7e0b137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.352476 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0556ba-3ae5-4b39-b6c0-5e29d7e0b137 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.363975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 917/1836] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:35.364628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941b34-8250-46c0-9faa-8f5289013640 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.381291 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941b34-8250-46c0-9faa-8f5289013640 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.395446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b9fbc-6a32-486e-bae7-666284eec01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.403858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fbc-6a32-486e-bae7-666284eec01a admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.403858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fbc-6a32-486e-bae7-666284eec01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.403858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b9fbc-6a32-486e-bae7-666284eec01a admin admin] PATH_INFO: `/v3/projects/07d201ef08d6474a9919400776a9b438/users/6d35d634ce674ebab451cc83fcdf7eba/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.439629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b9fbc-6a32-486e-bae7-666284eec01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d201ef08d6474a9919400776a9b438, user_id=6d35d634ce674ebab451cc83fcdf7eba, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.442308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b9fbc-6a32-486e-bae7-666284eec01a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.532031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 920/1837] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:35 2022] PUT /identity/v3/projects/07d201ef08d6474a9919400776a9b438/users/6d35d634ce674ebab451cc83fcdf7eba/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:35.542770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f79e-5d62-4e77-84e6-7f043db1104d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.543108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f79e-5d62-4e77-84e6-7f043db1104d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.543413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f79e-5d62-4e77-84e6-7f043db1104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.570355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d059f79e-5d62-4e77-84e6-7f043db1104d None None] MFA Rules not processed for user `6d35d634ce674ebab451cc83fcdf7eba`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:35.571610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d059f79e-5d62-4e77-84e6-7f043db1104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:35.636503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 918/1838] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:35.640856 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b9fbc-6a32-486e-bae7-666284eec01a admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.700931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b9fbc-6a32-486e-bae7-666284eec01a admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.705666 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f852e92-5317-4743-9aca-c78933119cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.706320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f852e92-5317-4743-9aca-c78933119cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.706604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f852e92-5317-4743-9aca-c78933119cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.706878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f852e92-5317-4743-9aca-c78933119cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.707571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f852e92-5317-4743-9aca-c78933119cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.709487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f852e92-5317-4743-9aca-c78933119cd9 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:35.824968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 921/1839] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:35 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:35.829151 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059f79e-5d62-4e77-84e6-7f043db1104d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:35.840028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059f79e-5d62-4e77-84e6-7f043db1104d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:35.898213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd89ca6-1d00-48e3-aff7-c9305c608ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:35.898846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd89ca6-1d00-48e3-aff7-c9305c608ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:35.899122 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd89ca6-1d00-48e3-aff7-c9305c608ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:35.899399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd89ca6-1d00-48e3-aff7-c9305c608ccb admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:35.900129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd89ca6-1d00-48e3-aff7-c9305c608ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:35.902037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd89ca6-1d00-48e3-aff7-c9305c608ccb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.005431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 919/1840] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:35 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:36.010238 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f852e92-5317-4743-9aca-c78933119cd9 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.022725 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f852e92-5317-4743-9aca-c78933119cd9 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.029266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9a06b-0992-4d0b-b35d-7382a182a072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.030238 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a06b-0992-4d0b-b35d-7382a182a072 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.030638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a06b-0992-4d0b-b35d-7382a182a072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.031012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9a06b-0992-4d0b-b35d-7382a182a072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.031884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9a06b-0992-4d0b-b35d-7382a182a072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.033589 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9a06b-0992-4d0b-b35d-7382a182a072 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.045224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 922/1841] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:36.049554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd89ca6-1d00-48e3-aff7-c9305c608ccb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.060421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd89ca6-1d00-48e3-aff7-c9305c608ccb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.065005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1bb08-c66c-4711-b608-756781a07c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.065884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1bb08-c66c-4711-b608-756781a07c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.066332 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1bb08-c66c-4711-b608-756781a07c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.066628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1bb08-c66c-4711-b608-756781a07c6a admin admin] PATH_INFO: `/v3/projects/626dcf4074a84fd8beda030a7134d688/users/818c82b4b8cf4f78a638479c9a4460ce/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.082159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1bb08-c66c-4711-b608-756781a07c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=626dcf4074a84fd8beda030a7134d688, user_id=818c82b4b8cf4f78a638479c9a4460ce, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.084824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1bb08-c66c-4711-b608-756781a07c6a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.114943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:36.203077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9a06b-0992-4d0b-b35d-7382a182a072 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.204106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 920/1842] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:36 2022] PUT /identity/v3/projects/626dcf4074a84fd8beda030a7134d688/users/818c82b4b8cf4f78a638479c9a4460ce/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:36.221860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9a06b-0992-4d0b-b35d-7382a182a072 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.288791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9ee19-f135-49f2-bc73-f971cbe2323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.292954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9ee19-f135-49f2-bc73-f971cbe2323a admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.292954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9ee19-f135-49f2-bc73-f971cbe2323a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.292954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9ee19-f135-49f2-bc73-f971cbe2323a admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.292954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9ee19-f135-49f2-bc73-f971cbe2323a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.294606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9ee19-f135-49f2-bc73-f971cbe2323a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.311148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1bb08-c66c-4711-b608-756781a07c6a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.323843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 923/1843] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:36.324604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1bb08-c66c-4711-b608-756781a07c6a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.329933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a721a6-229b-498e-851e-2d6cfb095b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.331058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a721a6-229b-498e-851e-2d6cfb095b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.331639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a721a6-229b-498e-851e-2d6cfb095b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.332056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a721a6-229b-498e-851e-2d6cfb095b84 admin admin] PATH_INFO: `/v3/projects/626dcf4074a84fd8beda030a7134d688/users/818c82b4b8cf4f78a638479c9a4460ce/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.334481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a721a6-229b-498e-851e-2d6cfb095b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626dcf4074a84fd8beda030a7134d688, user_id=818c82b4b8cf4f78a638479c9a4460ce, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.337173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a721a6-229b-498e-851e-2d6cfb095b84 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.350089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 921/1844] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:36 2022] PUT /identity/v3/projects/626dcf4074a84fd8beda030a7134d688/users/818c82b4b8cf4f78a638479c9a4460ce/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:36.361658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7020d4b-1090-48ad-b14b-e6324b112021 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.361961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7020d4b-1090-48ad-b14b-e6324b112021 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.362229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7020d4b-1090-48ad-b14b-e6324b112021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.391013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a7020d4b-1090-48ad-b14b-e6324b112021 None None] MFA Rules not processed for user `818c82b4b8cf4f78a638479c9a4460ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:36.392262 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a7020d4b-1090-48ad-b14b-e6324b112021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:36.473846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 924/1845] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:36.487663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a721a6-229b-498e-851e-2d6cfb095b84 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:36.489558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-81a721a6-229b-498e-851e-2d6cfb095b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:36.551777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a721a6-229b-498e-851e-2d6cfb095b84 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:36.555709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85d51c-704a-4fea-acd0-1a8ba663cc5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:36.556359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d51c-704a-4fea-acd0-1a8ba663cc5a service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:36.556647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d51c-704a-4fea-acd0-1a8ba663cc5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:36.557593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85d51c-704a-4fea-acd0-1a8ba663cc5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:36.568243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85d51c-704a-4fea-acd0-1a8ba663cc5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:36.569693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85d51c-704a-4fea-acd0-1a8ba663cc5a service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:36.582389 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 922/1846] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:37.398415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7020d4b-1090-48ad-b14b-e6324b112021 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:37.399971 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a7020d4b-1090-48ad-b14b-e6324b112021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:37.467134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85d51c-704a-4fea-acd0-1a8ba663cc5a service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:37.516911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7020d4b-1090-48ad-b14b-e6324b112021 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:37.524209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a82684-656a-49ac-af83-6175cf604aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:37.525397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82684-656a-49ac-af83-6175cf604aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.527894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82684-656a-49ac-af83-6175cf604aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.527894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a82684-656a-49ac-af83-6175cf604aed admin admin] PATH_INFO: `/v3/users/effb6e01e29144f28336a4d5083da2c3` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.528837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a82684-656a-49ac-af83-6175cf604aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=effb6e01e29144f28336a4d5083da2c3)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:37.532015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a82684-656a-49ac-af83-6175cf604aed admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:37.593573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85d51c-704a-4fea-acd0-1a8ba663cc5a service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:37.598707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d7448-f72d-4604-9e92-b6efdbd2c808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:37.602426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7448-f72d-4604-9e92-b6efdbd2c808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.602426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7448-f72d-4604-9e92-b6efdbd2c808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.602426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7448-f72d-4604-9e92-b6efdbd2c808 admin admin] PATH_INFO: `/v3/users/6d35d634ce674ebab451cc83fcdf7eba` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.602426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d7448-f72d-4604-9e92-b6efdbd2c808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d35d634ce674ebab451cc83fcdf7eba)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:37.603816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d7448-f72d-4604-9e92-b6efdbd2c808 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:37.813717 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a4a82684-656a-49ac-af83-6175cf604aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'effb6e01e29144f28336a4d5083da2c3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:37.827949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a4a82684-656a-49ac-af83-6175cf604aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'effb6e01e29144f28336a4d5083da2c3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:37.828954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a4a82684-656a-49ac-af83-6175cf604aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'effb6e01e29144f28336a4d5083da2c3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:37.837149 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a4a82684-656a-49ac-af83-6175cf604aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'effb6e01e29144f28336a4d5083da2c3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:37.837960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a4a82684-656a-49ac-af83-6175cf604aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'effb6e01e29144f28336a4d5083da2c3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:37.945359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:37.945508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 925/1847] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:37 2022] DELETE /identity/v3/users/effb6e01e29144f28336a4d5083da2c3 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:37.946924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38af6a-f1cc-4c9e-8525-4387a2297538 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:37.947303 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38af6a-f1cc-4c9e-8525-4387a2297538 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:37.947609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38af6a-f1cc-4c9e-8525-4387a2297538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:37.984360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7a38af6a-f1cc-4c9e-8525-4387a2297538 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:37.985592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7a38af6a-f1cc-4c9e-8525-4387a2297538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:37.989410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ec3d7448-f72d-4604-9e92-b6efdbd2c808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d35d634ce674ebab451cc83fcdf7eba'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:38.071770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 926/1848] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:38.082604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38af6a-f1cc-4c9e-8525-4387a2297538 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:38.084342 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7a38af6a-f1cc-4c9e-8525-4387a2297538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:38.092071 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ec3d7448-f72d-4604-9e92-b6efdbd2c808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d35d634ce674ebab451cc83fcdf7eba'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:38.108028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ec3d7448-f72d-4604-9e92-b6efdbd2c808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d35d634ce674ebab451cc83fcdf7eba'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:38.109038 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ec3d7448-f72d-4604-9e92-b6efdbd2c808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d35d634ce674ebab451cc83fcdf7eba'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:38.109837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ec3d7448-f72d-4604-9e92-b6efdbd2c808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d35d634ce674ebab451cc83fcdf7eba'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:38.125242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 923/1849] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:37 2022] DELETE /identity/v3/users/6d35d634ce674ebab451cc83fcdf7eba => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:38.129644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee6f2e-e75b-4156-9c69-39fe68633043 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.130263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee6f2e-e75b-4156-9c69-39fe68633043 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.130743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee6f2e-e75b-4156-9c69-39fe68633043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.151921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c7ee6f2e-e75b-4156-9c69-39fe68633043 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:38.153582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c7ee6f2e-e75b-4156-9c69-39fe68633043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:38.162264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38af6a-f1cc-4c9e-8525-4387a2297538 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:38.250208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a9831-17a6-44e0-85a8-4f6901b0bc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:38.251649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a9831-17a6-44e0-85a8-4f6901b0bc88 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.251907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a9831-17a6-44e0-85a8-4f6901b0bc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.252320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a9831-17a6-44e0-85a8-4f6901b0bc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.255350 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d99a9831-17a6-44e0-85a8-4f6901b0bc88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:38.271842 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 924/1850] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:38.284230 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee6f2e-e75b-4156-9c69-39fe68633043 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:38.286452 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c7ee6f2e-e75b-4156-9c69-39fe68633043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:38.301257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee6f2e-e75b-4156-9c69-39fe68633043 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:38.306276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399b98d-dc8b-4db6-86d2-2c35c08599f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:38.306933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399b98d-dc8b-4db6-86d2-2c35c08599f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.307220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399b98d-dc8b-4db6-86d2-2c35c08599f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.308034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399b98d-dc8b-4db6-86d2-2c35c08599f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.318122 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399b98d-dc8b-4db6-86d2-2c35c08599f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:38.319814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399b98d-dc8b-4db6-86d2-2c35c08599f8 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:38.331065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a9831-17a6-44e0-85a8-4f6901b0bc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:38.331708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 925/1851] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:38.336624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a9831-17a6-44e0-85a8-4f6901b0bc88 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:38.348724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 927/1852] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:38.543795 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:38.965551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399b98d-dc8b-4db6-86d2-2c35c08599f8 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:38.968345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a399b98d-dc8b-4db6-86d2-2c35c08599f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:38.985591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399b98d-dc8b-4db6-86d2-2c35c08599f8 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:38.991508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:38.993063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:38.993566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:38.994055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] PATH_INFO: `/v3/users/b9f11d96ad5c4560b12205638cd9239f` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:38.996019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f11d96ad5c4560b12205638cd9239f)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:38.998938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:39.209670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f11d96ad5c4560b12205638cd9239f'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.290844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f11d96ad5c4560b12205638cd9239f'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.316931 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f11d96ad5c4560b12205638cd9239f'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.317597 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f11d96ad5c4560b12205638cd9239f'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.318439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f11d96ad5c4560b12205638cd9239f'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.338240 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 926/1853] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:38 2022] DELETE /identity/v3/users/b9f11d96ad5c4560b12205638cd9239f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:39.342818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0913e96-d503-4231-b7c4-a7174ad116cf None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:39.343118 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0913e96-d503-4231-b7c4-a7174ad116cf None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:39.343409 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0913e96-d503-4231-b7c4-a7174ad116cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:39.364672 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a0913e96-d503-4231-b7c4-a7174ad116cf None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:39.366054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a0913e96-d503-4231-b7c4-a7174ad116cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:39.429951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:39.434427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:39.456012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 928/1854] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:39.457224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0913e96-d503-4231-b7c4-a7174ad116cf None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:39.458802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a0913e96-d503-4231-b7c4-a7174ad116cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:39.475085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0913e96-d503-4231-b7c4-a7174ad116cf None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:39.481680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:39.482634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:39.483716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:39.483716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] PATH_INFO: `/v3/projects/78211f94234a4e3fbe554e5f7085a111` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:39.484786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] RBAC: Authorizing `identity:delete_project(project_id=78211f94234a4e3fbe554e5f7085a111)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:39.486798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:39.595160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99033907-5e42-4383-8c31-072017b63364 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:39.602426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:39.603434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:39.603862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:39.604423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] PATH_INFO: `/v3/projects/07d201ef08d6474a9919400776a9b438` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:39.605904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d201ef08d6474a9919400776a9b438)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:39.608007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:39.636734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78211f94234a4e3fbe554e5f7085a111', 'request_id': 'req-b26e9168-8195-4ccf-a8f9-cf2b560aebde'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.724949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78211f94234a4e3fbe554e5f7085a111', 'request_id': 'req-b26e9168-8195-4ccf-a8f9-cf2b560aebde'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.734471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78211f94234a4e3fbe554e5f7085a111', 'request_id': 'req-b26e9168-8195-4ccf-a8f9-cf2b560aebde'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.746731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] The token cache is being invalidate because project 78211f94234a4e3fbe554e5f7085a111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:39.747018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.747343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d201ef08d6474a9919400776a9b438', 'request_id': 'req-43f0db19-a750-445b-ac6e-965f794bc051'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.747720 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.749545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 929/1855] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:39 2022] DELETE /identity/v3/projects/78211f94234a4e3fbe554e5f7085a111 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:39.752833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:39.753422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d201ef08d6474a9919400776a9b438', 'request_id': 'req-43f0db19-a750-445b-ac6e-965f794bc051'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.754131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:39.760202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d201ef08d6474a9919400776a9b438', 'request_id': 'req-43f0db19-a750-445b-ac6e-965f794bc051'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.810401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e9168-8195-4ccf-a8f9-cf2b560aebde admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:39.858755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010afa64-4be7-4b28-9cb9-bd5ace825a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:39.859345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010afa64-4be7-4b28-9cb9-bd5ace825a1f service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:39.859667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010afa64-4be7-4b28-9cb9-bd5ace825a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:39.859956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010afa64-4be7-4b28-9cb9-bd5ace825a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:39.861851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-010afa64-4be7-4b28-9cb9-bd5ace825a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:39.866363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] The token cache is being invalidate because project 07d201ef08d6474a9919400776a9b438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:39.866771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.867568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:39.869723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 927/1856] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:39 2022] DELETE /identity/v3/projects/07d201ef08d6474a9919400776a9b438 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:39.872811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:39.874426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:39.928798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010afa64-4be7-4b28-9cb9-bd5ace825a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:39.930242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010afa64-4be7-4b28-9cb9-bd5ace825a1f service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:39.940124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 930/1857] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:39.940939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010afa64-4be7-4b28-9cb9-bd5ace825a1f service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:39.942206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-010afa64-4be7-4b28-9cb9-bd5ace825a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:39.943200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0db19-a750-445b-ac6e-965f794bc051 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:39.950996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:39.951918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:39.952673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:39.952673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] PATH_INFO: `/v3/users/4c0fbff2e80441b78765349658b2940e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:39.953696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0fbff2e80441b78765349658b2940e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:39.955589 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010afa64-4be7-4b28-9cb9-bd5ace825a1f service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:39.955699 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:39.961045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:39.962038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:39.962333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:39.962616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] PATH_INFO: `/v3/users/818c82b4b8cf4f78a638479c9a4460ce` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:39.964669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=818c82b4b8cf4f78a638479c9a4460ce)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:39.966908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:40.012583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:40.199790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0fbff2e80441b78765349658b2940e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.222851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:40.238908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '818c82b4b8cf4f78a638479c9a4460ce'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.254989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '818c82b4b8cf4f78a638479c9a4460ce'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.259256 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '818c82b4b8cf4f78a638479c9a4460ce'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.270906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '818c82b4b8cf4f78a638479c9a4460ce'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.271939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '818c82b4b8cf4f78a638479c9a4460ce'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.328808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0fbff2e80441b78765349658b2940e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.354997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0fbff2e80441b78765349658b2940e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.357859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0fbff2e80441b78765349658b2940e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.358842 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0fbff2e80441b78765349658b2940e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:40.375485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 928/1858] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:39 2022] DELETE /identity/v3/users/4c0fbff2e80441b78765349658b2940e => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:40.458707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 931/1859] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:39 2022] DELETE /identity/v3/users/818c82b4b8cf4f78a638479c9a4460ce => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:40.903683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:40.905344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:40.982398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f342273-cd75-4913-8754-e4543c033b1b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:41.046180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:41.047067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:41.047392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:41.047831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] PATH_INFO: `/v3/projects/dbb25a1202c0457aa0e2fd6cd4fe087b` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:41.051504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb25a1202c0457aa0e2fd6cd4fe087b)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:41.051504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:41.052950 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:41.055026 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:41.071324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9aed36-04a0-4289-bed7-dc014ce00948 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:41.079408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:41.080550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:41.080995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:41.081905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] PATH_INFO: `/v3/projects/e6a5f874558a4176869d3b314711b4d6` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:41.084018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a5f874558a4176869d3b314711b4d6)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:41.087299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:41.184026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb25a1202c0457aa0e2fd6cd4fe087b', 'request_id': 'req-10cce8bd-234f-4c71-9884-a82ba76aead8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.189623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb25a1202c0457aa0e2fd6cd4fe087b', 'request_id': 'req-10cce8bd-234f-4c71-9884-a82ba76aead8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.196665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb25a1202c0457aa0e2fd6cd4fe087b', 'request_id': 'req-10cce8bd-234f-4c71-9884-a82ba76aead8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.220404 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a5f874558a4176869d3b314711b4d6', 'request_id': 'req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.331710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] The token cache is being invalidate because project dbb25a1202c0457aa0e2fd6cd4fe087b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:41.332175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.332934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.337883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 929/1860] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:40 2022] DELETE /identity/v3/projects/dbb25a1202c0457aa0e2fd6cd4fe087b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:41.337883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:41.337883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:41.355611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:41.407870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cce8bd-234f-4c71-9884-a82ba76aead8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:41.411058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a5f874558a4176869d3b314711b4d6', 'request_id': 'req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.420073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a5f874558a4176869d3b314711b4d6', 'request_id': 'req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.428227 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:41.431916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] The token cache is being invalidate because project e6a5f874558a4176869d3b314711b4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:41.433032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.434300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.436413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 932/1861] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:41 2022] DELETE /identity/v3/projects/e6a5f874558a4176869d3b314711b4d6 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:41.437394 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:41.438926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:41.498966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:41.499957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:41.502542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:41.502542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] PATH_INFO: `/v3/projects/626dcf4074a84fd8beda030a7134d688` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:41.502542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] RBAC: Authorizing `identity:delete_project(project_id=626dcf4074a84fd8beda030a7134d688)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:41.504136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:41.551737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5eae16-aa92-432b-9fef-a0fa96bfa94a admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:41.557871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfabcd-72af-4b59-b5db-d94a25071468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:41.558875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfabcd-72af-4b59-b5db-d94a25071468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:41.559229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfabcd-72af-4b59-b5db-d94a25071468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:41.559603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfabcd-72af-4b59-b5db-d94a25071468 admin admin] PATH_INFO: `/v3/users/b8970560e51a44bfbc932f5f9355a8b1` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:41.561390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfabcd-72af-4b59-b5db-d94a25071468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8970560e51a44bfbc932f5f9355a8b1)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:41.563683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfabcd-72af-4b59-b5db-d94a25071468 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:41.656519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626dcf4074a84fd8beda030a7134d688', 'request_id': 'req-2599a548-90eb-45ad-a024-3574c345607b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.663335 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626dcf4074a84fd8beda030a7134d688', 'request_id': 'req-2599a548-90eb-45ad-a024-3574c345607b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.671381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626dcf4074a84fd8beda030a7134d688', 'request_id': 'req-2599a548-90eb-45ad-a024-3574c345607b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.779032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] The token cache is being invalidate because project 626dcf4074a84fd8beda030a7134d688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:41.779293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.781425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2599a548-90eb-45ad-a024-3574c345607b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.781774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 930/1862] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:41 2022] DELETE /identity/v3/projects/626dcf4074a84fd8beda030a7134d688 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:41.783371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e8608-166b-4159-9d10-645b644b445e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:41.783493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e8608-166b-4159-9d10-645b644b445e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:41.783947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e8608-166b-4159-9d10-645b644b445e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:41.788859 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-c1dfabcd-72af-4b59-b5db-d94a25071468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8970560e51a44bfbc932f5f9355a8b1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.812089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-c1dfabcd-72af-4b59-b5db-d94a25071468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8970560e51a44bfbc932f5f9355a8b1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.814335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-c1dfabcd-72af-4b59-b5db-d94a25071468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8970560e51a44bfbc932f5f9355a8b1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.822262 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-395e8608-166b-4159-9d10-645b644b445e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:41.825694 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-395e8608-166b-4159-9d10-645b644b445e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:41.828904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-c1dfabcd-72af-4b59-b5db-d94a25071468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8970560e51a44bfbc932f5f9355a8b1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.829889 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-c1dfabcd-72af-4b59-b5db-d94a25071468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8970560e51a44bfbc932f5f9355a8b1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:41.920508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 933/1863] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:41 2022] DELETE /identity/v3/users/b8970560e51a44bfbc932f5f9355a8b1 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:41.924960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3130f-99ef-41fd-9c69-35c738d6f8cf None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:41.925389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3130f-99ef-41fd-9c69-35c738d6f8cf None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:41.925865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3130f-99ef-41fd-9c69-35c738d6f8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:41.947496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 931/1864] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:41.951163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b2c3130f-99ef-41fd-9c69-35c738d6f8cf None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:41.965727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b2c3130f-99ef-41fd-9c69-35c738d6f8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:41.965830 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b6de3-84fa-4460-b727-f151b0f35411 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:41.965830 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b6de3-84fa-4460-b727-f151b0f35411 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:41.965830 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b6de3-84fa-4460-b727-f151b0f35411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.004430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-757b6de3-84fa-4460-b727-f151b0f35411 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:42.005775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-757b6de3-84fa-4460-b727-f151b0f35411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:42.024269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 934/1865] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:42.032497 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7ccf4-deec-42f0-be3e-ff9f47a76068 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.032897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7ccf4-deec-42f0-be3e-ff9f47a76068 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.033128 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7ccf4-deec-42f0-be3e-ff9f47a76068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.052329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-02a7ccf4-deec-42f0-be3e-ff9f47a76068 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:42.053887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-02a7ccf4-deec-42f0-be3e-ff9f47a76068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:42.067452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 935/1866] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:42.068609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7ccf4-deec-42f0-be3e-ff9f47a76068 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.081509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7ccf4-deec-42f0-be3e-ff9f47a76068 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.087811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe513-542d-49b5-af0a-9c2e1f7f9d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.088518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe513-542d-49b5-af0a-9c2e1f7f9d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.088818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe513-542d-49b5-af0a-9c2e1f7f9d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.089619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe513-542d-49b5-af0a-9c2e1f7f9d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.089812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe513-542d-49b5-af0a-9c2e1f7f9d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:42.090091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe513-542d-49b5-af0a-9c2e1f7f9d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.093161 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe513-542d-49b5-af0a-9c2e1f7f9d82 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.102939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 932/1867] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:42.105084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 936/1868] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:42.107345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b6de3-84fa-4460-b727-f151b0f35411 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.109107 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe513-542d-49b5-af0a-9c2e1f7f9d82 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.117817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b6de3-84fa-4460-b727-f151b0f35411 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.120488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe513-542d-49b5-af0a-9c2e1f7f9d82 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.124015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448321b6-9a4a-467d-b0f8-f23a84d461c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.124958 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448321b6-9a4a-467d-b0f8-f23a84d461c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.125405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448321b6-9a4a-467d-b0f8-f23a84d461c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.125517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681fedd-2a31-41ba-ac64-054e31782c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.125828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448321b6-9a4a-467d-b0f8-f23a84d461c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.126679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448321b6-9a4a-467d-b0f8-f23a84d461c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:42.127102 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448321b6-9a4a-467d-b0f8-f23a84d461c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.127840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681fedd-2a31-41ba-ac64-054e31782c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.128135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681fedd-2a31-41ba-ac64-054e31782c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.128418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681fedd-2a31-41ba-ac64-054e31782c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.129123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681fedd-2a31-41ba-ac64-054e31782c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.129433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448321b6-9a4a-467d-b0f8-f23a84d461c6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.131467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681fedd-2a31-41ba-ac64-054e31782c00 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.147897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 933/1869] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:13:42.151149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448321b6-9a4a-467d-b0f8-f23a84d461c6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.161930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448321b6-9a4a-467d-b0f8-f23a84d461c6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.169224 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce22630-5761-404f-a94c-83dbc2947086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.172660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce22630-5761-404f-a94c-83dbc2947086 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.172660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce22630-5761-404f-a94c-83dbc2947086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.172660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce22630-5761-404f-a94c-83dbc2947086 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.172660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce22630-5761-404f-a94c-83dbc2947086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.173560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce22630-5761-404f-a94c-83dbc2947086 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.258704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 937/1870] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:42 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:42.259967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681fedd-2a31-41ba-ac64-054e31782c00 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.316011 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 934/1871] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:42 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:42.316982 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce22630-5761-404f-a94c-83dbc2947086 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.328557 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681fedd-2a31-41ba-ac64-054e31782c00 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.388588 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce22630-5761-404f-a94c-83dbc2947086 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.393810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239468ae-8fe3-4d3e-98ee-27e1dbf7a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.394503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239468ae-8fe3-4d3e-98ee-27e1dbf7a8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.394924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239468ae-8fe3-4d3e-98ee-27e1dbf7a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.395209 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239468ae-8fe3-4d3e-98ee-27e1dbf7a8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.395961 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239468ae-8fe3-4d3e-98ee-27e1dbf7a8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.397470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37cfb1-e159-4700-8a30-4a138312c310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.397909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239468ae-8fe3-4d3e-98ee-27e1dbf7a8f4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.398162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37cfb1-e159-4700-8a30-4a138312c310 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.398507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37cfb1-e159-4700-8a30-4a138312c310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.398831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37cfb1-e159-4700-8a30-4a138312c310 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.399446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37cfb1-e159-4700-8a30-4a138312c310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.401633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37cfb1-e159-4700-8a30-4a138312c310 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.480647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 935/1872] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:42 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:42.486078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239468ae-8fe3-4d3e-98ee-27e1dbf7a8f4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.501067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239468ae-8fe3-4d3e-98ee-27e1dbf7a8f4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.503427 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 938/1873] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:42 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:42.510472 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e097ac8-fbfd-4258-a0d2-add169d10266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.510472 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e097ac8-fbfd-4258-a0d2-add169d10266 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.510472 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e097ac8-fbfd-4258-a0d2-add169d10266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.510472 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e097ac8-fbfd-4258-a0d2-add169d10266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.512356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37cfb1-e159-4700-8a30-4a138312c310 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.512479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e097ac8-fbfd-4258-a0d2-add169d10266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.513977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e097ac8-fbfd-4258-a0d2-add169d10266 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.522536 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37cfb1-e159-4700-8a30-4a138312c310 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.526324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 936/1874] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:42.531090 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e097ac8-fbfd-4258-a0d2-add169d10266 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.531520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f301d-10cc-4030-b1c9-cc0afead9713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.532579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f301d-10cc-4030-b1c9-cc0afead9713 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.532740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f301d-10cc-4030-b1c9-cc0afead9713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.533110 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f301d-10cc-4030-b1c9-cc0afead9713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.533948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f301d-10cc-4030-b1c9-cc0afead9713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.535849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f301d-10cc-4030-b1c9-cc0afead9713 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.542451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e097ac8-fbfd-4258-a0d2-add169d10266 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.547573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829ed78-e6e5-42b5-a41b-f744b579f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.548423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829ed78-e6e5-42b5-a41b-f744b579f98f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.548545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829ed78-e6e5-42b5-a41b-f744b579f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.548822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829ed78-e6e5-42b5-a41b-f744b579f98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.552329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829ed78-e6e5-42b5-a41b-f744b579f98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.552489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 939/1875] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:42.552574 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829ed78-e6e5-42b5-a41b-f744b579f98f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.553551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f301d-10cc-4030-b1c9-cc0afead9713 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.563983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 937/1876] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:42.569737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f301d-10cc-4030-b1c9-cc0afead9713 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.576019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e753-e6f6-44da-9472-0de1133ef3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.576630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e753-e6f6-44da-9472-0de1133ef3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.576898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e753-e6f6-44da-9472-0de1133ef3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.584357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e753-e6f6-44da-9472-0de1133ef3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.584357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89e753-e6f6-44da-9472-0de1133ef3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.584940 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829ed78-e6e5-42b5-a41b-f744b579f98f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.585119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89e753-e6f6-44da-9472-0de1133ef3d5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.590764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829ed78-e6e5-42b5-a41b-f744b579f98f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.591624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 940/1877] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:42.595917 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e753-e6f6-44da-9472-0de1133ef3d5 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.606725 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e753-e6f6-44da-9472-0de1133ef3d5 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:42.619255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036144a-62b3-46cc-a657-198b1f117d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.620857 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036144a-62b3-46cc-a657-198b1f117d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.621146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036144a-62b3-46cc-a657-198b1f117d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.621427 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036144a-62b3-46cc-a657-198b1f117d0b admin admin] PATH_INFO: `/v3/projects/6ddfe5d8b125420193f0aff08228480b/users/69de41c9c2a2474487055e64cf3b396b/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.639385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036144a-62b3-46cc-a657-198b1f117d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ddfe5d8b125420193f0aff08228480b, user_id=69de41c9c2a2474487055e64cf3b396b, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.642324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036144a-62b3-46cc-a657-198b1f117d0b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.652202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdab7a-6cf6-4af7-b36d-1f8b71a7abb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:42.653669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdab7a-6cf6-4af7-b36d-1f8b71a7abb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.654015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdab7a-6cf6-4af7-b36d-1f8b71a7abb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.654299 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdab7a-6cf6-4af7-b36d-1f8b71a7abb2 admin admin] PATH_INFO: `/v3/projects/df5147927644488f80d0350633d4126d/users/7cc281f134514eaca6d6300e119864a3/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.672385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdab7a-6cf6-4af7-b36d-1f8b71a7abb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5147927644488f80d0350633d4126d, user_id=7cc281f134514eaca6d6300e119864a3, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:42.675772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdab7a-6cf6-4af7-b36d-1f8b71a7abb2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:42.754401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 941/1878] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:42 2022] PUT /identity/v3/projects/6ddfe5d8b125420193f0aff08228480b/users/69de41c9c2a2474487055e64cf3b396b/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:42.765881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca122e-2e98-425e-9dd3-b4ff9191bf7f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.766894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca122e-2e98-425e-9dd3-b4ff9191bf7f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.767201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca122e-2e98-425e-9dd3-b4ff9191bf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.783052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:42.791218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 938/1879] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:42 2022] PUT /identity/v3/projects/df5147927644488f80d0350633d4126d/users/7cc281f134514eaca6d6300e119864a3/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:42.802135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba860d-7a12-4d2e-9f3a-4d5acc7adc49 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:42.802439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba860d-7a12-4d2e-9f3a-4d5acc7adc49 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:42.802724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba860d-7a12-4d2e-9f3a-4d5acc7adc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:42.832983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-8eca122e-2e98-425e-9dd3-b4ff9191bf7f None None] MFA Rules not processed for user `69de41c9c2a2474487055e64cf3b396b`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:42.834737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8eca122e-2e98-425e-9dd3-b4ff9191bf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:42.844621 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f2ba860d-7a12-4d2e-9f3a-4d5acc7adc49 None None] MFA Rules not processed for user `7cc281f134514eaca6d6300e119864a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:42.847983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f2ba860d-7a12-4d2e-9f3a-4d5acc7adc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:42.990346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 942/1880] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:42.991166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca122e-2e98-425e-9dd3-b4ff9191bf7f None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:42.994028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8eca122e-2e98-425e-9dd3-b4ff9191bf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:43.056975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 939/1881] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:43.058415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba860d-7a12-4d2e-9f3a-4d5acc7adc49 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:43.062097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f2ba860d-7a12-4d2e-9f3a-4d5acc7adc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:43.155249 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca122e-2e98-425e-9dd3-b4ff9191bf7f None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.168096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.168999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.169287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.169575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] PATH_INFO: `/v3/projects/12bee5ca9a194e5094b0d740cc15127d` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.172387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] RBAC: Authorizing `identity:delete_project(project_id=12bee5ca9a194e5094b0d740cc15127d)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:43.174319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:43.204496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba860d-7a12-4d2e-9f3a-4d5acc7adc49 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.210723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206938b-406e-4918-9388-d7ce5239bb0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.212453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206938b-406e-4918-9388-d7ce5239bb0b service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.213007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206938b-406e-4918-9388-d7ce5239bb0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.214404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206938b-406e-4918-9388-d7ce5239bb0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.227313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206938b-406e-4918-9388-d7ce5239bb0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:43.232329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206938b-406e-4918-9388-d7ce5239bb0b service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:43.246278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 940/1882] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:43.247365 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206938b-406e-4918-9388-d7ce5239bb0b service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:43.260103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206938b-406e-4918-9388-d7ce5239bb0b service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.279318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35749e51-9887-4ae8-be2f-3bd82b1a82de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.281490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35749e51-9887-4ae8-be2f-3bd82b1a82de admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.281884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35749e51-9887-4ae8-be2f-3bd82b1a82de admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.282261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35749e51-9887-4ae8-be2f-3bd82b1a82de admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.283107 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35749e51-9887-4ae8-be2f-3bd82b1a82de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:43.285870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35749e51-9887-4ae8-be2f-3bd82b1a82de admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:43.327662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:43.361244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12bee5ca9a194e5094b0d740cc15127d', 'request_id': 'req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.398981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 941/1883] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:43 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:43.398981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35749e51-9887-4ae8-be2f-3bd82b1a82de admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:43.460749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12bee5ca9a194e5094b0d740cc15127d', 'request_id': 'req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.472250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12bee5ca9a194e5094b0d740cc15127d', 'request_id': 'req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.491342 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] The token cache is being invalidate because project 12bee5ca9a194e5094b0d740cc15127d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:43.491735 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.492858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:43.501802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 943/1884] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:42 2022] DELETE /identity/v3/projects/12bee5ca9a194e5094b0d740cc15127d => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:43.501802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:43.503248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:43.514153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35749e51-9887-4ae8-be2f-3bd82b1a82de admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.520748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.521829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.532668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.532668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] PATH_INFO: `/v3/users/69de41c9c2a2474487055e64cf3b396b` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.532668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69de41c9c2a2474487055e64cf3b396b)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:43.532668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:43.592647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21347de-8ed3-4fdf-b8d1-6930e8b8184e admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:43.599425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4081e45-e90a-4b13-bfaf-5864258e79f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:43.600377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081e45-e90a-4b13-bfaf-5864258e79f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:43.600782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081e45-e90a-4b13-bfaf-5864258e79f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:43.602050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4081e45-e90a-4b13-bfaf-5864258e79f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:43.602545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4081e45-e90a-4b13-bfaf-5864258e79f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:43.605133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4081e45-e90a-4b13-bfaf-5864258e79f5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.183715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 944/1885] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:43 2022] POST /identity/v3/users => generated 296 bytes in 686 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:44.185275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e62d7-b397-4b79-a973-e4d3870afb3d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.185575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e62d7-b397-4b79-a973-e4d3870afb3d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.185897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e62d7-b397-4b79-a973-e4d3870afb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.201115 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69de41c9c2a2474487055e64cf3b396b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.216711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-030e62d7-b397-4b79-a973-e4d3870afb3d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:44.218089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-030e62d7-b397-4b79-a973-e4d3870afb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.235418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 945/1886] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:44.235418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e62d7-b397-4b79-a973-e4d3870afb3d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.250280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e62d7-b397-4b79-a973-e4d3870afb3d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.256968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f622c-1359-45d1-a2d0-26609ff0b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.257810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f622c-1359-45d1-a2d0-26609ff0b3cf admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.258693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f622c-1359-45d1-a2d0-26609ff0b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.259162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f622c-1359-45d1-a2d0-26609ff0b3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.260931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f622c-1359-45d1-a2d0-26609ff0b3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.263964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f622c-1359-45d1-a2d0-26609ff0b3cf admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.277805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 946/1887] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:44.279373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420b7ff-4aa4-43e3-8497-e8143fdcecdb None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.279859 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420b7ff-4aa4-43e3-8497-e8143fdcecdb None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.280367 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420b7ff-4aa4-43e3-8497-e8143fdcecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.301327 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7420b7ff-4aa4-43e3-8497-e8143fdcecdb None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:44.302799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7420b7ff-4aa4-43e3-8497-e8143fdcecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.311067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69de41c9c2a2474487055e64cf3b396b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.320539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 947/1888] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:44.325815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73800050-938c-4a05-959f-285814d80a08 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.326106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73800050-938c-4a05-959f-285814d80a08 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.326386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73800050-938c-4a05-959f-285814d80a08 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.328692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 948/1889] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:13:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:13:44.329807 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73800050-938c-4a05-959f-285814d80a08 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.329959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69de41c9c2a2474487055e64cf3b396b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.331415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69de41c9c2a2474487055e64cf3b396b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.332445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69de41c9c2a2474487055e64cf3b396b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.343989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73800050-938c-4a05-959f-285814d80a08 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.348837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0207ce8-b4cd-4007-8d1a-e63f52dfcca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.349758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0207ce8-b4cd-4007-8d1a-e63f52dfcca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.350031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0207ce8-b4cd-4007-8d1a-e63f52dfcca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.350313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0207ce8-b4cd-4007-8d1a-e63f52dfcca2 admin admin] PATH_INFO: `/v3/projects/3cdbd402ba8840319f70cda96bd4fb00/users/25acfd5eecb744608f45a96f752ee6fd/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.360832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 942/1890] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:43 2022] DELETE /identity/v3/users/69de41c9c2a2474487055e64cf3b396b => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:44.362417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.365354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.367010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0207ce8-b4cd-4007-8d1a-e63f52dfcca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cdbd402ba8840319f70cda96bd4fb00, user_id=25acfd5eecb744608f45a96f752ee6fd, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.370373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0207ce8-b4cd-4007-8d1a-e63f52dfcca2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.456033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895dc579-827e-469f-b7cc-34f737a235c0 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.461143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f557-70d5-4801-8fa8-869bc12118b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.461829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f557-70d5-4801-8fa8-869bc12118b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.462136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f557-70d5-4801-8fa8-869bc12118b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.462404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f557-70d5-4801-8fa8-869bc12118b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.463202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29f557-70d5-4801-8fa8-869bc12118b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:44.463671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29f557-70d5-4801-8fa8-869bc12118b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.465676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29f557-70d5-4801-8fa8-869bc12118b1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.479628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 943/1891] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:44.481232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877997f-1a10-4a95-b969-3135af7ab15d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.481692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877997f-1a10-4a95-b969-3135af7ab15d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.482142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877997f-1a10-4a95-b969-3135af7ab15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.487309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 949/1892] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:44 2022] PUT /identity/v3/projects/3cdbd402ba8840319f70cda96bd4fb00/users/25acfd5eecb744608f45a96f752ee6fd/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:44.491109 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdcfcc-620b-44e2-bc71-bf32309aa852 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.491109 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdcfcc-620b-44e2-bc71-bf32309aa852 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.491109 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdcfcc-620b-44e2-bc71-bf32309aa852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.509705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6877997f-1a10-4a95-b969-3135af7ab15d None None] MFA Rules not processed for user `fbdf5c7049f8499b8a25c88fbf4cb795`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:44.510030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-32cdcfcc-620b-44e2-bc71-bf32309aa852 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:44.511745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6877997f-1a10-4a95-b969-3135af7ab15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.511869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-32cdcfcc-620b-44e2-bc71-bf32309aa852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.594938 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 950/1893] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:44.598690 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdcfcc-620b-44e2-bc71-bf32309aa852 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.602481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 944/1894] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:44.603441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877997f-1a10-4a95-b969-3135af7ab15d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.605529 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6877997f-1a10-4a95-b969-3135af7ab15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.611182 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdcfcc-620b-44e2-bc71-bf32309aa852 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.618122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a40316-178b-4368-bae4-aac6487c6cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.618997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40316-178b-4368-bae4-aac6487c6cea admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.619482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40316-178b-4368-bae4-aac6487c6cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.620801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a40316-178b-4368-bae4-aac6487c6cea admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.621674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a40316-178b-4368-bae4-aac6487c6cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.623830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a40316-178b-4368-bae4-aac6487c6cea admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.624127 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877997f-1a10-4a95-b969-3135af7ab15d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.628791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73d436-ddf4-44a1-be4e-28a598ddf010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.630337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73d436-ddf4-44a1-be4e-28a598ddf010 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.630337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73d436-ddf4-44a1-be4e-28a598ddf010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.630337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73d436-ddf4-44a1-be4e-28a598ddf010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.630776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73d436-ddf4-44a1-be4e-28a598ddf010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.633160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73d436-ddf4-44a1-be4e-28a598ddf010 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.649412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 945/1895] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:44.650860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73d436-ddf4-44a1-be4e-28a598ddf010 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.653315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ed73d436-ddf4-44a1-be4e-28a598ddf010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.666906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73d436-ddf4-44a1-be4e-28a598ddf010 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.671796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.672756 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.673105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.673451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] PATH_INFO: `/v3/users/9cebaa257d1b446991509fe54bad9fb7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.674859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cebaa257d1b446991509fe54bad9fb7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.676921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.747139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 951/1896] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:44 2022] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:44.747139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a40316-178b-4368-bae4-aac6487c6cea admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.749085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-51a40316-178b-4368-bae4-aac6487c6cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.812560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a40316-178b-4368-bae4-aac6487c6cea admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.816297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5860e5f-0065-4fb3-8701-44658efb53e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.816951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860e5f-0065-4fb3-8701-44658efb53e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.817241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860e5f-0065-4fb3-8701-44658efb53e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.817522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5860e5f-0065-4fb3-8701-44658efb53e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.889364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5860e5f-0065-4fb3-8701-44658efb53e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.890819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5860e5f-0065-4fb3-8701-44658efb53e3 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:44.901968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 952/1897] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:44.902823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5860e5f-0065-4fb3-8701-44658efb53e3 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:44.904301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c5860e5f-0065-4fb3-8701-44658efb53e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:44.940011 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cebaa257d1b446991509fe54bad9fb7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:44.977053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5860e5f-0065-4fb3-8701-44658efb53e3 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:44.982646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd85fa-fcca-4928-b2b6-489b05541cb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdf5c7049f8499b8a25c88fbf4cb795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:44.983397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd85fa-fcca-4928-b2b6-489b05541cb2 service placement] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:44.983631 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd85fa-fcca-4928-b2b6-489b05541cb2 service placement] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:44.984025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd85fa-fcca-4928-b2b6-489b05541cb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:44.993059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd85fa-fcca-4928-b2b6-489b05541cb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:44.995259 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd85fa-fcca-4928-b2b6-489b05541cb2 service placement] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.005621 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 953/1898] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:45.006405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd85fa-fcca-4928-b2b6-489b05541cb2 service placement] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.011855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cebaa257d1b446991509fe54bad9fb7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.026603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cebaa257d1b446991509fe54bad9fb7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.026880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd85fa-fcca-4928-b2b6-489b05541cb2 service placement] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.027435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cebaa257d1b446991509fe54bad9fb7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.028235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cebaa257d1b446991509fe54bad9fb7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.032298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b7246-2ecb-421c-ade4-314cf7ad7955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.033397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7246-2ecb-421c-ade4-314cf7ad7955 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.034053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7246-2ecb-421c-ade4-314cf7ad7955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.034053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b7246-2ecb-421c-ade4-314cf7ad7955 admin admin] PATH_INFO: `/v3/projects/3cdbd402ba8840319f70cda96bd4fb00/users/25acfd5eecb744608f45a96f752ee6fd/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.036681 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b7246-2ecb-421c-ade4-314cf7ad7955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cdbd402ba8840319f70cda96bd4fb00, user_id=25acfd5eecb744608f45a96f752ee6fd, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.039447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b7246-2ecb-421c-ade4-314cf7ad7955 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.043553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 946/1899] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:44 2022] DELETE /identity/v3/users/9cebaa257d1b446991509fe54bad9fb7 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:45.050920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.050920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.051633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 954/1900] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:45 2022] PUT /identity/v3/projects/3cdbd402ba8840319f70cda96bd4fb00/users/25acfd5eecb744608f45a96f752ee6fd/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:45.064755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348acb-6fd1-43dd-b6c7-e4e18e7729f3 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.066434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348acb-6fd1-43dd-b6c7-e4e18e7729f3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.066434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348acb-6fd1-43dd-b6c7-e4e18e7729f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.115946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-37348acb-6fd1-43dd-b6c7-e4e18e7729f3 None None] MFA Rules not processed for user `25acfd5eecb744608f45a96f752ee6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:45.117651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-37348acb-6fd1-43dd-b6c7-e4e18e7729f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.149031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a63b4-8eac-45e5-bc0e-7ada36c5eb2a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.215761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 955/1901] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:45.226494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348acb-6fd1-43dd-b6c7-e4e18e7729f3 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.227990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-37348acb-6fd1-43dd-b6c7-e4e18e7729f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.231351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e057712-a9ad-45e5-8a33-fa37793da4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.231351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e057712-a9ad-45e5-8a33-fa37793da4cd admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.231351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e057712-a9ad-45e5-8a33-fa37793da4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.231351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e057712-a9ad-45e5-8a33-fa37793da4cd admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.246243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e057712-a9ad-45e5-8a33-fa37793da4cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.253436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e057712-a9ad-45e5-8a33-fa37793da4cd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.315908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348acb-6fd1-43dd-b6c7-e4e18e7729f3 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.319567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fdd65-b9c1-43af-b008-d0dd48c089bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.320338 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fdd65-b9c1-43af-b008-d0dd48c089bb service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.320628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fdd65-b9c1-43af-b008-d0dd48c089bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.320903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fdd65-b9c1-43af-b008-d0dd48c089bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.323419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-2f9fdd65-b9c1-43af-b008-d0dd48c089bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.369008 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 947/1902] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:45 2022] POST /identity/v3/users => generated 296 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:45.375028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e057712-a9ad-45e5-8a33-fa37793da4cd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.388432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e057712-a9ad-45e5-8a33-fa37793da4cd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.397328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06826a-658a-4d8e-b9e8-b09e928c3a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.397580 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:45.397682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06826a-658a-4d8e-b9e8-b09e928c3a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.397682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06826a-658a-4d8e-b9e8-b09e928c3a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.397682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06826a-658a-4d8e-b9e8-b09e928c3a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.397682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06826a-658a-4d8e-b9e8-b09e928c3a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.398009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fdd65-b9c1-43af-b008-d0dd48c089bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.398304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fdd65-b9c1-43af-b008-d0dd48c089bb service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.398598 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06826a-658a-4d8e-b9e8-b09e928c3a3e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.412970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 948/1904] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:45.413201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 956/1904] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:45.413930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06826a-658a-4d8e-b9e8-b09e928c3a3e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.415767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6a06826a-658a-4d8e-b9e8-b09e928c3a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.417145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fdd65-b9c1-43af-b008-d0dd48c089bb service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.429161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06826a-658a-4d8e-b9e8-b09e928c3a3e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.430091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fdd65-b9c1-43af-b008-d0dd48c089bb service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.434319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.435195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.435481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.435792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] PATH_INFO: `/v3/projects/9c58727e748f4ab087bac6eb671d1db9` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.437214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c58727e748f4ab087bac6eb671d1db9)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.438998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57b8e1-4fa0-4af5-8ea0-204aeee36cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.438998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57b8e1-4fa0-4af5-8ea0-204aeee36cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.439235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.440153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57b8e1-4fa0-4af5-8ea0-204aeee36cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.440974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57b8e1-4fa0-4af5-8ea0-204aeee36cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.441726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57b8e1-4fa0-4af5-8ea0-204aeee36cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.443777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57b8e1-4fa0-4af5-8ea0-204aeee36cdb admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.462502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 957/1905] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:45.466489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57b8e1-4fa0-4af5-8ea0-204aeee36cdb admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.474119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:45.488373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57b8e1-4fa0-4af5-8ea0-204aeee36cdb admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.499748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db317e-3caf-48fc-8170-15bcb4dee1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.501613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db317e-3caf-48fc-8170-15bcb4dee1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.502083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db317e-3caf-48fc-8170-15bcb4dee1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.502370 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db317e-3caf-48fc-8170-15bcb4dee1fc admin admin] PATH_INFO: `/v3/projects/9d971232ef7b46598eac20f2819afa34/users/3b81c3b9c26946faadc6c7a5a76d537a/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.522743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db317e-3caf-48fc-8170-15bcb4dee1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d971232ef7b46598eac20f2819afa34, user_id=3b81c3b9c26946faadc6c7a5a76d537a, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.525642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db317e-3caf-48fc-8170-15bcb4dee1fc admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.674390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 958/1906] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:45 2022] PUT /identity/v3/projects/9d971232ef7b46598eac20f2819afa34/users/3b81c3b9c26946faadc6c7a5a76d537a/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:45.676799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c58727e748f4ab087bac6eb671d1db9', 'request_id': 'req-d38eeeb2-3993-48d7-942d-d5c6e121b171'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.678960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dfb8d-aa1f-4f0f-b945-f1c8fa70bcee None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.679220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dfb8d-aa1f-4f0f-b945-f1c8fa70bcee None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.679715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dfb8d-aa1f-4f0f-b945-f1c8fa70bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.683879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c58727e748f4ab087bac6eb671d1db9', 'request_id': 'req-d38eeeb2-3993-48d7-942d-d5c6e121b171'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.694868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c58727e748f4ab087bac6eb671d1db9', 'request_id': 'req-d38eeeb2-3993-48d7-942d-d5c6e121b171'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.714728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-696dfb8d-aa1f-4f0f-b945-f1c8fa70bcee None None] MFA Rules not processed for user `3b81c3b9c26946faadc6c7a5a76d537a`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:45.717232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-696dfb8d-aa1f-4f0f-b945-f1c8fa70bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.795922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] The token cache is being invalidate because project 9c58727e748f4ab087bac6eb671d1db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:45.796340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.797109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d38eeeb2-3993-48d7-942d-d5c6e121b171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:45.804606 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 949/1907] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:45 2022] DELETE /identity/v3/projects/9c58727e748f4ab087bac6eb671d1db9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:45.804606 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb340f2-072c-4f2f-8d88-7e0bb20c5a66 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.804606 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb340f2-072c-4f2f-8d88-7e0bb20c5a66 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.805014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 959/1908] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:45.805336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb340f2-072c-4f2f-8d88-7e0bb20c5a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.806286 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dfb8d-aa1f-4f0f-b945-f1c8fa70bcee None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.830829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bcb340f2-072c-4f2f-8d88-7e0bb20c5a66 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:45.830829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bcb340f2-072c-4f2f-8d88-7e0bb20c5a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.908607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dfb8d-aa1f-4f0f-b945-f1c8fa70bcee None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:45.915983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ac105-3be1-4ec3-b119-b6ec742037e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:45.916806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ac105-3be1-4ec3-b119-b6ec742037e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.917156 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ac105-3be1-4ec3-b119-b6ec742037e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.917694 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ac105-3be1-4ec3-b119-b6ec742037e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.918586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ac105-3be1-4ec3-b119-b6ec742037e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:45.920812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ac105-3be1-4ec3-b119-b6ec742037e2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:45.933090 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 950/1909] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:45.943601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2496b0-8295-4121-aa95-0b8bb2cd62e1 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:45.948712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2496b0-8295-4121-aa95-0b8bb2cd62e1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:45.950265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2496b0-8295-4121-aa95-0b8bb2cd62e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:45.970325 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8f2496b0-8295-4121-aa95-0b8bb2cd62e1 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:45.980058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8f2496b0-8295-4121-aa95-0b8bb2cd62e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:45.984173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 951/1910] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:45.985182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2496b0-8295-4121-aa95-0b8bb2cd62e1 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:45.996824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2496b0-8295-4121-aa95-0b8bb2cd62e1 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.003506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1a3ef-9e6d-4e41-b063-72592a9a47b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.009342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1a3ef-9e6d-4e41-b063-72592a9a47b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.009342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1a3ef-9e6d-4e41-b063-72592a9a47b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.009342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1a3ef-9e6d-4e41-b063-72592a9a47b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.009342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1a3ef-9e6d-4e41-b063-72592a9a47b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:46.009342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1a3ef-9e6d-4e41-b063-72592a9a47b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.009342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1a3ef-9e6d-4e41-b063-72592a9a47b6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.024787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 952/1911] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:13:46.029989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1a3ef-9e6d-4e41-b063-72592a9a47b6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.044835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 960/1912] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:45 2022] POST /identity/v3/projects => generated 391 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:46.046901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ac105-3be1-4ec3-b119-b6ec742037e2 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.049338 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1a3ef-9e6d-4e41-b063-72592a9a47b6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.049667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-2d2ac105-3be1-4ec3-b119-b6ec742037e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.137755 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b287f34-0f54-4af6-9909-4f84bb225514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.138431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b287f34-0f54-4af6-9909-4f84bb225514 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.138715 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b287f34-0f54-4af6-9909-4f84bb225514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.138999 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b287f34-0f54-4af6-9909-4f84bb225514 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.139811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b287f34-0f54-4af6-9909-4f84bb225514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.148794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b287f34-0f54-4af6-9909-4f84bb225514 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.158779 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ac105-3be1-4ec3-b119-b6ec742037e2 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.170773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.171684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.171969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.172251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] PATH_INFO: `/v3/projects/6ddfe5d8b125420193f0aff08228480b` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.173515 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ddfe5d8b125420193f0aff08228480b)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.175490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.261855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 953/1913] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:46 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:46.264285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b287f34-0f54-4af6-9909-4f84bb225514 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.269511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7b287f34-0f54-4af6-9909-4f84bb225514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.330944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ddfe5d8b125420193f0aff08228480b', 'request_id': 'req-ecda77fa-7056-4f7f-988a-7a98813e5e93'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:46.369289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b287f34-0f54-4af6-9909-4f84bb225514 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.399614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ddfe5d8b125420193f0aff08228480b', 'request_id': 'req-ecda77fa-7056-4f7f-988a-7a98813e5e93'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:46.407296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ddfe5d8b125420193f0aff08228480b', 'request_id': 'req-ecda77fa-7056-4f7f-988a-7a98813e5e93'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:46.418454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] The token cache is being invalidate because project 6ddfe5d8b125420193f0aff08228480b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:46.418747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:46.419462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:46.421412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 961/1914] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:46 2022] DELETE /identity/v3/projects/6ddfe5d8b125420193f0aff08228480b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:46.422964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.424031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.447303 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd233ea-174b-4021-aadb-2ba940919fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.448825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd233ea-174b-4021-aadb-2ba940919fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.449049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd233ea-174b-4021-aadb-2ba940919fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.449327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd233ea-174b-4021-aadb-2ba940919fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.450024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd233ea-174b-4021-aadb-2ba940919fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.452000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd233ea-174b-4021-aadb-2ba940919fcc admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.493759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda77fa-7056-4f7f-988a-7a98813e5e93 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.499221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db51da-1c81-4a36-aa98-1946f62aad0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.499932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db51da-1c81-4a36-aa98-1946f62aad0d admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.500219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db51da-1c81-4a36-aa98-1946f62aad0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.500526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db51da-1c81-4a36-aa98-1946f62aad0d admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.501224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db51da-1c81-4a36-aa98-1946f62aad0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.503157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db51da-1c81-4a36-aa98-1946f62aad0d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.547987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 954/1915] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:46 2022] POST /identity/v3/users => generated 302 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:46.547987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bda5b-895e-4fe0-965e-563edb43b558 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.547987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bda5b-895e-4fe0-965e-563edb43b558 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.547987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bda5b-895e-4fe0-965e-563edb43b558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.566756 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-328bda5b-895e-4fe0-965e-563edb43b558 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:46.568026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-328bda5b-895e-4fe0-965e-563edb43b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.576561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 955/1916] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:46.578494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bda5b-895e-4fe0-965e-563edb43b558 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.584013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-328bda5b-895e-4fe0-965e-563edb43b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.597014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bda5b-895e-4fe0-965e-563edb43b558 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.602057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68f291-b5ba-4e8b-8819-c0b0dbd3feac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.602720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68f291-b5ba-4e8b-8819-c0b0dbd3feac admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.603007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68f291-b5ba-4e8b-8819-c0b0dbd3feac admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.603280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68f291-b5ba-4e8b-8819-c0b0dbd3feac admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.604293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68f291-b5ba-4e8b-8819-c0b0dbd3feac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.606409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68f291-b5ba-4e8b-8819-c0b0dbd3feac admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.616809 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 956/1917] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:46.617999 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05955a-dc89-4f5b-b9f7-f30a558c833e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.618221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05955a-dc89-4f5b-b9f7-f30a558c833e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.618500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05955a-dc89-4f5b-b9f7-f30a558c833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.637621 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6f05955a-dc89-4f5b-b9f7-f30a558c833e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:46.638770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6f05955a-dc89-4f5b-b9f7-f30a558c833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:46.653291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 957/1918] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:46.653291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05955a-dc89-4f5b-b9f7-f30a558c833e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.658417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 962/1919] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:46 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:46.659791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db51da-1c81-4a36-aa98-1946f62aad0d admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.669285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05955a-dc89-4f5b-b9f7-f30a558c833e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.672324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db51da-1c81-4a36-aa98-1946f62aad0d admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.675032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410302d-4551-4c41-9356-648b22d374a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.676201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410302d-4551-4c41-9356-648b22d374a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.682841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410302d-4551-4c41-9356-648b22d374a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.682841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410302d-4551-4c41-9356-648b22d374a6 admin admin] PATH_INFO: `/v3/projects/bf389a9776d44ce7bc94d981659581f0/users/1896262b94ac40d79a0afb8d4288cb54/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.683105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9663a2a-f4dd-4dac-a3db-03f59f7a9cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.683105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663a2a-f4dd-4dac-a3db-03f59f7a9cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.683105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663a2a-f4dd-4dac-a3db-03f59f7a9cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.683105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9663a2a-f4dd-4dac-a3db-03f59f7a9cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.683464 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9663a2a-f4dd-4dac-a3db-03f59f7a9cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:46.683464 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9663a2a-f4dd-4dac-a3db-03f59f7a9cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.684510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9663a2a-f4dd-4dac-a3db-03f59f7a9cfb admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.694616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410302d-4551-4c41-9356-648b22d374a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf389a9776d44ce7bc94d981659581f0, user_id=1896262b94ac40d79a0afb8d4288cb54, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.697349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410302d-4551-4c41-9356-648b22d374a6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.697479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 963/1920] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:46.702421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9663a2a-f4dd-4dac-a3db-03f59f7a9cfb admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.712548 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9663a2a-f4dd-4dac-a3db-03f59f7a9cfb admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.717918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49231a-68b0-48bb-81ca-1971175590aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.718580 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49231a-68b0-48bb-81ca-1971175590aa admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.718860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49231a-68b0-48bb-81ca-1971175590aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.719134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49231a-68b0-48bb-81ca-1971175590aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.719885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49231a-68b0-48bb-81ca-1971175590aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.721536 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49231a-68b0-48bb-81ca-1971175590aa admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.735413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 964/1921] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:46.735413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49231a-68b0-48bb-81ca-1971175590aa admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.746357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49231a-68b0-48bb-81ca-1971175590aa admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.751047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe4f9-0c56-458e-b9bc-db24724bc4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.751722 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe4f9-0c56-458e-b9bc-db24724bc4da admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.752013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe4f9-0c56-458e-b9bc-db24724bc4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.752288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe4f9-0c56-458e-b9bc-db24724bc4da admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.752967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbe4f9-0c56-458e-b9bc-db24724bc4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.754856 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbe4f9-0c56-458e-b9bc-db24724bc4da admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.800312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 958/1922] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:46 2022] PUT /identity/v3/projects/bf389a9776d44ce7bc94d981659581f0/users/1896262b94ac40d79a0afb8d4288cb54/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:46.804580 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410302d-4551-4c41-9356-648b22d374a6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.871471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 965/1923] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:46 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:46.871471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe4f9-0c56-458e-b9bc-db24724bc4da admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.871732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410302d-4551-4c41-9356-648b22d374a6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.933177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe4f9-0c56-458e-b9bc-db24724bc4da admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.934107 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2667a5-93d0-4f87-90fa-c8b699de9e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.934777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2667a5-93d0-4f87-90fa-c8b699de9e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.935064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2667a5-93d0-4f87-90fa-c8b699de9e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.935339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2667a5-93d0-4f87-90fa-c8b699de9e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.936102 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2667a5-93d0-4f87-90fa-c8b699de9e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.937801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2667a5-93d0-4f87-90fa-c8b699de9e1f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.937905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682d76f-0812-4860-9573-abcb372cc563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.938563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682d76f-0812-4860-9573-abcb372cc563 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.938850 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682d76f-0812-4860-9573-abcb372cc563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.939133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682d76f-0812-4860-9573-abcb372cc563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.939897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682d76f-0812-4860-9573-abcb372cc563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.941501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682d76f-0812-4860-9573-abcb372cc563 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.948436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 959/1924] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:46.949355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2667a5-93d0-4f87-90fa-c8b699de9e1f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.952558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 966/1925] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:46.953253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682d76f-0812-4860-9573-abcb372cc563 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:46.962722 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682d76f-0812-4860-9573-abcb372cc563 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.965310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2667a5-93d0-4f87-90fa-c8b699de9e1f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:46.967452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a64a26-aace-4bbb-a67c-123b60088090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.968350 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a64a26-aace-4bbb-a67c-123b60088090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.968636 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a64a26-aace-4bbb-a67c-123b60088090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.968912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a64a26-aace-4bbb-a67c-123b60088090 admin admin] PATH_INFO: `/v3/projects/43dff609016148a4b8621ca2083b81b4/users/8fa7313f44374d5aae99c9f52daf7253/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.970205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f1df9-e5d0-4e85-9051-82e5a94ec64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:46.970857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f1df9-e5d0-4e85-9051-82e5a94ec64d admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:46.971165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f1df9-e5d0-4e85-9051-82e5a94ec64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:46.971438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f1df9-e5d0-4e85-9051-82e5a94ec64d admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:46.972164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f1df9-e5d0-4e85-9051-82e5a94ec64d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.974281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f1df9-e5d0-4e85-9051-82e5a94ec64d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:46.984163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a64a26-aace-4bbb-a67c-123b60088090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43dff609016148a4b8621ca2083b81b4, user_id=8fa7313f44374d5aae99c9f52daf7253, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:46.986830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a64a26-aace-4bbb-a67c-123b60088090 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.067799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 960/1926] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:46 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:47.068596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f1df9-e5d0-4e85-9051-82e5a94ec64d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.077870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f1df9-e5d0-4e85-9051-82e5a94ec64d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.082537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc925fa6-c132-482d-902e-7898d92c2798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.083512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc925fa6-c132-482d-902e-7898d92c2798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.083905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc925fa6-c132-482d-902e-7898d92c2798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.084177 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc925fa6-c132-482d-902e-7898d92c2798 admin admin] PATH_INFO: `/v3/projects/bf389a9776d44ce7bc94d981659581f0/users/1896262b94ac40d79a0afb8d4288cb54/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.086032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc925fa6-c132-482d-902e-7898d92c2798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf389a9776d44ce7bc94d981659581f0, user_id=1896262b94ac40d79a0afb8d4288cb54, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.089329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc925fa6-c132-482d-902e-7898d92c2798 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.091754 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 967/1927] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:46 2022] PUT /identity/v3/projects/43dff609016148a4b8621ca2083b81b4/users/8fa7313f44374d5aae99c9f52daf7253/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:47.103518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a64a26-aace-4bbb-a67c-123b60088090 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.110226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 961/1928] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:47 2022] PUT /identity/v3/projects/bf389a9776d44ce7bc94d981659581f0/users/1896262b94ac40d79a0afb8d4288cb54/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:47.111759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9873ea-1fa6-4124-9b1a-703a22f7c06e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.112129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9873ea-1fa6-4124-9b1a-703a22f7c06e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.112511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9873ea-1fa6-4124-9b1a-703a22f7c06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.145388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3a9873ea-1fa6-4124-9b1a-703a22f7c06e None None] MFA Rules not processed for user `8fa7313f44374d5aae99c9f52daf7253`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:47.146532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3a9873ea-1fa6-4124-9b1a-703a22f7c06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.159391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a64a26-aace-4bbb-a67c-123b60088090 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.214888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 962/1929] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:47.216265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5731d-d1bb-41e2-acb7-44451288378c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.216561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5731d-d1bb-41e2-acb7-44451288378c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.216985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5731d-d1bb-41e2-acb7-44451288378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.219918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f516b3-6038-4437-9d74-539f3c722aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.220714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f516b3-6038-4437-9d74-539f3c722aac admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.221191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f516b3-6038-4437-9d74-539f3c722aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.221573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f516b3-6038-4437-9d74-539f3c722aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.222463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f516b3-6038-4437-9d74-539f3c722aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.224146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f516b3-6038-4437-9d74-539f3c722aac admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.228575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:47.238607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 968/1930] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:47.238607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f516b3-6038-4437-9d74-539f3c722aac admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.240677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-12f516b3-6038-4437-9d74-539f3c722aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.244039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-cac5731d-d1bb-41e2-acb7-44451288378c None None] MFA Rules not processed for user `1896262b94ac40d79a0afb8d4288cb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:47.245709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cac5731d-d1bb-41e2-acb7-44451288378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.274706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:47.299105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f516b3-6038-4437-9d74-539f3c722aac admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.303091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b93f-c5da-45b8-aadd-efebadfaf73f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.303775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b93f-c5da-45b8-aadd-efebadfaf73f service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.304064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b93f-c5da-45b8-aadd-efebadfaf73f service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.304343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b93f-c5da-45b8-aadd-efebadfaf73f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.315248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9b93f-c5da-45b8-aadd-efebadfaf73f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.317269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9b93f-c5da-45b8-aadd-efebadfaf73f service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.318862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 963/1931] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:47.322325 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5731d-d1bb-41e2-acb7-44451288378c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.330594 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5731d-d1bb-41e2-acb7-44451288378c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.331377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 969/1932] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:47.335246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2163cf-9d0b-4516-ad9a-4bb8512f1c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.335940 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2163cf-9d0b-4516-ad9a-4bb8512f1c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.336228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2163cf-9d0b-4516-ad9a-4bb8512f1c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.336509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2163cf-9d0b-4516-ad9a-4bb8512f1c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.337468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2163cf-9d0b-4516-ad9a-4bb8512f1c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.338881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2163cf-9d0b-4516-ad9a-4bb8512f1c84 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.354226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 964/1933] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:47.358127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b93f-c5da-45b8-aadd-efebadfaf73f service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.369212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b93f-c5da-45b8-aadd-efebadfaf73f service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.373295 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2163cf-9d0b-4516-ad9a-4bb8512f1c84 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.375078 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a12ba-82b5-49f4-b66a-89f73f6cdd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.375213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bd2163cf-9d0b-4516-ad9a-4bb8512f1c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.376035 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a12ba-82b5-49f4-b66a-89f73f6cdd98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.376325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a12ba-82b5-49f4-b66a-89f73f6cdd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.376752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a12ba-82b5-49f4-b66a-89f73f6cdd98 admin admin] PATH_INFO: `/v3/projects/8e6c9a61e7a544aeb610ca4adfc95dfa/users/e83bfd01c18f46ea90f8270eb755d750/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.388790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2163cf-9d0b-4516-ad9a-4bb8512f1c84 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.392538 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a12ba-82b5-49f4-b66a-89f73f6cdd98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6c9a61e7a544aeb610ca4adfc95dfa, user_id=e83bfd01c18f46ea90f8270eb755d750, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.394064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a82b36-f35f-44f4-8e54-fc16be462080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.394370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a82b36-f35f-44f4-8e54-fc16be462080 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.394646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a82b36-f35f-44f4-8e54-fc16be462080 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.394919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a82b36-f35f-44f4-8e54-fc16be462080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.395187 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a12ba-82b5-49f4-b66a-89f73f6cdd98 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.409283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a82b36-f35f-44f4-8e54-fc16be462080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.409283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a82b36-f35f-44f4-8e54-fc16be462080 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.415687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 965/1934] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:47.457730 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a82b36-f35f-44f4-8e54-fc16be462080 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.464299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 970/1935] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:47 2022] PUT /identity/v3/projects/8e6c9a61e7a544aeb610ca4adfc95dfa/users/e83bfd01c18f46ea90f8270eb755d750/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:47.472866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a82b36-f35f-44f4-8e54-fc16be462080 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.474808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582560-e1c4-4770-bb55-f75369a8e300 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.475906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582560-e1c4-4770-bb55-f75369a8e300 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.476206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44582560-e1c4-4770-bb55-f75369a8e300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.507844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-44582560-e1c4-4770-bb55-f75369a8e300 None None] MFA Rules not processed for user `e83bfd01c18f46ea90f8270eb755d750`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:47.509057 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-44582560-e1c4-4770-bb55-f75369a8e300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.523609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058e17b-8d78-4504-bc45-9b9347efdd91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.524276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058e17b-8d78-4504-bc45-9b9347efdd91 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.524556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058e17b-8d78-4504-bc45-9b9347efdd91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.526604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058e17b-8d78-4504-bc45-9b9347efdd91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.526821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8058e17b-8d78-4504-bc45-9b9347efdd91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.573949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 971/1936] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:47.578887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44582560-e1c4-4770-bb55-f75369a8e300 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.597725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058e17b-8d78-4504-bc45-9b9347efdd91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.599299 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058e17b-8d78-4504-bc45-9b9347efdd91 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.610028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 966/1937] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:47.642689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44582560-e1c4-4770-bb55-f75369a8e300 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.647294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9c14-79eb-4c63-a94d-473ea5cbc208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.647988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9c14-79eb-4c63-a94d-473ea5cbc208 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.648299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9c14-79eb-4c63-a94d-473ea5cbc208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.648533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9c14-79eb-4c63-a94d-473ea5cbc208 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.649223 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9c14-79eb-4c63-a94d-473ea5cbc208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.651167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9c14-79eb-4c63-a94d-473ea5cbc208 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.655998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058e17b-8d78-4504-bc45-9b9347efdd91 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.664403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058e17b-8d78-4504-bc45-9b9347efdd91 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.669300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de349de-6172-4059-803e-ef1edd7f8d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.669992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de349de-6172-4059-803e-ef1edd7f8d83 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.670277 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de349de-6172-4059-803e-ef1edd7f8d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.670967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de349de-6172-4059-803e-ef1edd7f8d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.672519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8de349de-6172-4059-803e-ef1edd7f8d83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:47.731619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de349de-6172-4059-803e-ef1edd7f8d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.733052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de349de-6172-4059-803e-ef1edd7f8d83 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.741848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 967/1938] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:47.765041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 972/1939] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:47.769075 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de349de-6172-4059-803e-ef1edd7f8d83 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.784971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de349de-6172-4059-803e-ef1edd7f8d83 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.844798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351dccb-e27d-42d6-ab98-2abb85448a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.845569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351dccb-e27d-42d6-ab98-2abb85448a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.845876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351dccb-e27d-42d6-ab98-2abb85448a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.846222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351dccb-e27d-42d6-ab98-2abb85448a0e admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.846941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351dccb-e27d-42d6-ab98-2abb85448a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.849022 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351dccb-e27d-42d6-ab98-2abb85448a0e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:47.970624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9c14-79eb-4c63-a94d-473ea5cbc208 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:47.972825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 968/1940] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:47 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:47.992038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9c14-79eb-4c63-a94d-473ea5cbc208 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:47.992038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ca38-db9c-4374-8f69-ea1933d9ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:47.992038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ca38-db9c-4374-8f69-ea1933d9ae96 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:47.992038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ca38-db9c-4374-8f69-ea1933d9ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:47.996469 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78ca38-db9c-4374-8f69-ea1933d9ae96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:47.996469 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78ca38-db9c-4374-8f69-ea1933d9ae96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:47.996469 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78ca38-db9c-4374-8f69-ea1933d9ae96 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.012655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 973/1941] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:48.016833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351dccb-e27d-42d6-ab98-2abb85448a0e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.028960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351dccb-e27d-42d6-ab98-2abb85448a0e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.033975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473e76b-d58a-4676-80a3-29ff72beb5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.034860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e76b-d58a-4676-80a3-29ff72beb5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.035192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e76b-d58a-4676-80a3-29ff72beb5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.035539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e76b-d58a-4676-80a3-29ff72beb5b5 admin admin] PATH_INFO: `/v3/projects/ba6f191494fe413094d28e6a7d39c16b/users/33fb089b5aa94ee3b0e2cb2e22da50e7/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.050710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473e76b-d58a-4676-80a3-29ff72beb5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6f191494fe413094d28e6a7d39c16b, user_id=33fb089b5aa94ee3b0e2cb2e22da50e7, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.053595 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473e76b-d58a-4676-80a3-29ff72beb5b5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.142583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:48.151840 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 969/1942] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:48 2022] PUT /identity/v3/projects/ba6f191494fe413094d28e6a7d39c16b/users/33fb089b5aa94ee3b0e2cb2e22da50e7/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:48.155642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ca38-db9c-4374-8f69-ea1933d9ae96 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.166162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78ca38-db9c-4374-8f69-ea1933d9ae96 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.226661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df853d6-2c5e-461d-9742-daf97d550bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.227332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df853d6-2c5e-461d-9742-daf97d550bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.227648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df853d6-2c5e-461d-9742-daf97d550bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.227934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df853d6-2c5e-461d-9742-daf97d550bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.228659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df853d6-2c5e-461d-9742-daf97d550bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.231227 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df853d6-2c5e-461d-9742-daf97d550bf9 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.241574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 974/1943] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:48.246572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473e76b-d58a-4676-80a3-29ff72beb5b5 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.256995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473e76b-d58a-4676-80a3-29ff72beb5b5 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.262097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc01e4-0bbb-4f29-81d7-5fbde1a16cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.262968 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc01e4-0bbb-4f29-81d7-5fbde1a16cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.263250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc01e4-0bbb-4f29-81d7-5fbde1a16cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.263548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc01e4-0bbb-4f29-81d7-5fbde1a16cf4 admin admin] PATH_INFO: `/v3/projects/ba6f191494fe413094d28e6a7d39c16b/users/33fb089b5aa94ee3b0e2cb2e22da50e7/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.265533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc01e4-0bbb-4f29-81d7-5fbde1a16cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6f191494fe413094d28e6a7d39c16b, user_id=33fb089b5aa94ee3b0e2cb2e22da50e7, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.268182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc01e4-0bbb-4f29-81d7-5fbde1a16cf4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.278677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 970/1944] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:48 2022] PUT /identity/v3/projects/ba6f191494fe413094d28e6a7d39c16b/users/33fb089b5aa94ee3b0e2cb2e22da50e7/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:48.288655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953e559-c0fc-4112-b1e5-12628d4bb899 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.288977 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953e559-c0fc-4112-b1e5-12628d4bb899 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.289265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953e559-c0fc-4112-b1e5-12628d4bb899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.318674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b953e559-c0fc-4112-b1e5-12628d4bb899 None None] MFA Rules not processed for user `33fb089b5aa94ee3b0e2cb2e22da50e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:48.319924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b953e559-c0fc-4112-b1e5-12628d4bb899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:48.388437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 975/1945] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:48.391117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:48.399153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc01e4-0bbb-4f29-81d7-5fbde1a16cf4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:48.457569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc01e4-0bbb-4f29-81d7-5fbde1a16cf4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:48.461422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fd1c5-f646-4e25-89a4-1db417e5f942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:48.462073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd1c5-f646-4e25-89a4-1db417e5f942 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:48.462358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd1c5-f646-4e25-89a4-1db417e5f942 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:48.462639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fd1c5-f646-4e25-89a4-1db417e5f942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:48.530410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fd1c5-f646-4e25-89a4-1db417e5f942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:48.530410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fd1c5-f646-4e25-89a4-1db417e5f942 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:48.536428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 971/1946] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:49.642625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:49.894274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:50.945713 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:51.145296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:51.733054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953e559-c0fc-4112-b1e5-12628d4bb899 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:51.797304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953e559-c0fc-4112-b1e5-12628d4bb899 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:51.802045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:51.803163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:51.803589 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:51.805121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:51.810940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] PATH_INFO: `/v3/users/e83bfd01c18f46ea90f8270eb755d750` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:51.810940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83bfd01c18f46ea90f8270eb755d750)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:51.810940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:51.981689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83bfd01c18f46ea90f8270eb755d750'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:51.993700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83bfd01c18f46ea90f8270eb755d750'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:51.994389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83bfd01c18f46ea90f8270eb755d750'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:52.001168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83bfd01c18f46ea90f8270eb755d750'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:52.001894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83bfd01c18f46ea90f8270eb755d750'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:52.033530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:52.067330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 976/1947] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:51 2022] DELETE /identity/v3/users/e83bfd01c18f46ea90f8270eb755d750 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:52.071862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8ae5b-08c7-4c88-b32a-eb314c1e66fc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:52.072155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8ae5b-08c7-4c88-b32a-eb314c1e66fc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:52.072437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8ae5b-08c7-4c88-b32a-eb314c1e66fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:52.091380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d3d8ae5b-08c7-4c88-b32a-eb314c1e66fc None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:52.092629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d3d8ae5b-08c7-4c88-b32a-eb314c1e66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:52.153955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 972/1948] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:52.163574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:52.165203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:52.226222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a2ab-d567-49bb-97f5-e275f0162659 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:52.228077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984ed39-daea-4938-aae0-87f23eb97f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:52.228722 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984ed39-daea-4938-aae0-87f23eb97f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:52.229011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984ed39-daea-4938-aae0-87f23eb97f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:52.229285 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984ed39-daea-4938-aae0-87f23eb97f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:52.238605 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984ed39-daea-4938-aae0-87f23eb97f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:52.240076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984ed39-daea-4938-aae0-87f23eb97f5e service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:52.249983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 977/1949] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:52.762887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8ae5b-08c7-4c88-b32a-eb314c1e66fc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:52.764483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d3d8ae5b-08c7-4c88-b32a-eb314c1e66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:52.777905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8ae5b-08c7-4c88-b32a-eb314c1e66fc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:52.783607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:52.784587 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:52.784880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:52.785357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] PATH_INFO: `/v3/projects/8e6c9a61e7a544aeb610ca4adfc95dfa` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:52.786696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6c9a61e7a544aeb610ca4adfc95dfa)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:52.788759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:52.914186 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6c9a61e7a544aeb610ca4adfc95dfa', 'request_id': 'req-9b9a8950-fb6d-4e1f-b372-efa8853738c8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:52.920596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6c9a61e7a544aeb610ca4adfc95dfa', 'request_id': 'req-9b9a8950-fb6d-4e1f-b372-efa8853738c8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:52.927432 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6c9a61e7a544aeb610ca4adfc95dfa', 'request_id': 'req-9b9a8950-fb6d-4e1f-b372-efa8853738c8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.039873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] The token cache is being invalidate because project 8e6c9a61e7a544aeb610ca4adfc95dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:53.040931 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.042430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.044341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 973/1950] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:52 2022] DELETE /identity/v3/projects/8e6c9a61e7a544aeb610ca4adfc95dfa => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:53.048283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984ed39-daea-4938-aae0-87f23eb97f5e service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:53.058885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984ed39-daea-4938-aae0-87f23eb97f5e service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:53.100420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:53.101435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:53.132416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:53.133620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:53.133906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:53.134189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] PATH_INFO: `/v3/users/33fb089b5aa94ee3b0e2cb2e22da50e7` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:53.135882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fb089b5aa94ee3b0e2cb2e22da50e7)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:53.137837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:53.176881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a8950-fb6d-4e1f-b372-efa8853738c8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:53.183112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ec0e8-a498-428f-95b3-d3f8a42f40e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:53.183455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ec0e8-a498-428f-95b3-d3f8a42f40e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:53.183764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ec0e8-a498-428f-95b3-d3f8a42f40e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:53.184043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ec0e8-a498-428f-95b3-d3f8a42f40e2 admin admin] PATH_INFO: `/v3/users/3b81c3b9c26946faadc6c7a5a76d537a` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:53.185247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ec0e8-a498-428f-95b3-d3f8a42f40e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b81c3b9c26946faadc6c7a5a76d537a)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:53.187145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ec0e8-a498-428f-95b3-d3f8a42f40e2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:53.202965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:53.319237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:53.333459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fb089b5aa94ee3b0e2cb2e22da50e7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.346424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fb089b5aa94ee3b0e2cb2e22da50e7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.347192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fb089b5aa94ee3b0e2cb2e22da50e7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.355444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fb089b5aa94ee3b0e2cb2e22da50e7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.356027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fb089b5aa94ee3b0e2cb2e22da50e7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.417146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c45ec0e8-a498-428f-95b3-d3f8a42f40e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b81c3b9c26946faadc6c7a5a76d537a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.439433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 978/1951] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:53 2022] DELETE /identity/v3/users/33fb089b5aa94ee3b0e2cb2e22da50e7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:53.521774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:53.524068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:53.547893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c45ec0e8-a498-428f-95b3-d3f8a42f40e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b81c3b9c26946faadc6c7a5a76d537a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.570272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c45ec0e8-a498-428f-95b3-d3f8a42f40e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b81c3b9c26946faadc6c7a5a76d537a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.571009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c45ec0e8-a498-428f-95b3-d3f8a42f40e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b81c3b9c26946faadc6c7a5a76d537a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.571649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c45ec0e8-a498-428f-95b3-d3f8a42f40e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b81c3b9c26946faadc6c7a5a76d537a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.586975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 974/1952] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:53 2022] DELETE /identity/v3/users/3b81c3b9c26946faadc6c7a5a76d537a => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:53.591324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eac9b-98b4-42ea-a006-f0d87de1f8a3 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:53.591738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eac9b-98b4-42ea-a006-f0d87de1f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:53.592116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139eac9b-98b4-42ea-a006-f0d87de1f8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:53.601644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc242fd-622c-4127-99df-332a2356bbb4 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:53.619002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-139eac9b-98b4-42ea-a006-f0d87de1f8a3 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:53.622569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-139eac9b-98b4-42ea-a006-f0d87de1f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:53.684044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ee00f-f056-43c9-abd7-c88746baf798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:53.685041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ee00f-f056-43c9-abd7-c88746baf798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:53.685332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ee00f-f056-43c9-abd7-c88746baf798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:53.685613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ee00f-f056-43c9-abd7-c88746baf798 admin admin] PATH_INFO: `/v3/users/7cc281f134514eaca6d6300e119864a3` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:53.687462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ee00f-f056-43c9-abd7-c88746baf798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc281f134514eaca6d6300e119864a3)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:53.690354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ee00f-f056-43c9-abd7-c88746baf798 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:53.716152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 975/1953] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:53.724604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eac9b-98b4-42ea-a006-f0d87de1f8a3 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:53.726893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-139eac9b-98b4-42ea-a006-f0d87de1f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:53.793220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139eac9b-98b4-42ea-a006-f0d87de1f8a3 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:53.796943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14746175-8bfe-492a-b8a8-49df5586d9d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:53.800079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14746175-8bfe-492a-b8a8-49df5586d9d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:53.800420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14746175-8bfe-492a-b8a8-49df5586d9d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:53.800711 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14746175-8bfe-492a-b8a8-49df5586d9d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:53.815623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14746175-8bfe-492a-b8a8-49df5586d9d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:53.817420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14746175-8bfe-492a-b8a8-49df5586d9d5 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:53.829555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 976/1954] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:53.920441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-134ee00f-f056-43c9-abd7-c88746baf798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc281f134514eaca6d6300e119864a3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.939622 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-134ee00f-f056-43c9-abd7-c88746baf798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc281f134514eaca6d6300e119864a3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.939622 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-134ee00f-f056-43c9-abd7-c88746baf798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc281f134514eaca6d6300e119864a3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.944001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-134ee00f-f056-43c9-abd7-c88746baf798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc281f134514eaca6d6300e119864a3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:53.944756 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-134ee00f-f056-43c9-abd7-c88746baf798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc281f134514eaca6d6300e119864a3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.018644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14746175-8bfe-492a-b8a8-49df5586d9d5 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:54.022448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-14746175-8bfe-492a-b8a8-49df5586d9d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:54.027939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 979/1955] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:53 2022] DELETE /identity/v3/users/7cc281f134514eaca6d6300e119864a3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:54.032588 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1cfcf-7dd0-4b18-93ee-315f34897dda None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.033133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1cfcf-7dd0-4b18-93ee-315f34897dda None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.033544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1cfcf-7dd0-4b18-93ee-315f34897dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.054493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14746175-8bfe-492a-b8a8-49df5586d9d5 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:54.064127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-99c1cfcf-7dd0-4b18-93ee-315f34897dda None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:54.065225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-99c1cfcf-7dd0-4b18-93ee-315f34897dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:54.142475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:54.143444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.143836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.144196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] PATH_INFO: `/v3/projects/ba6f191494fe413094d28e6a7d39c16b` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.144956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 980/1956] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:54.145589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6f191494fe413094d28e6a7d39c16b)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:54.147606 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:54.159257 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1cfcf-7dd0-4b18-93ee-315f34897dda None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:54.160551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-99c1cfcf-7dd0-4b18-93ee-315f34897dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:54.218177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1cfcf-7dd0-4b18-93ee-315f34897dda None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:54.221867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ac9ac-6b77-4199-995e-f29b8e7fafba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:54.230372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac9ac-6b77-4199-995e-f29b8e7fafba service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.230372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac9ac-6b77-4199-995e-f29b8e7fafba service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.230372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac9ac-6b77-4199-995e-f29b8e7fafba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.232482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ac9ac-6b77-4199-995e-f29b8e7fafba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:54.233932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ac9ac-6b77-4199-995e-f29b8e7fafba service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:54.243251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 981/1957] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:54.264539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6f191494fe413094d28e6a7d39c16b', 'request_id': 'req-e2dea342-2b75-429d-b239-d518f83deeab'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.268281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:54.270587 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6f191494fe413094d28e6a7d39c16b', 'request_id': 'req-e2dea342-2b75-429d-b239-d518f83deeab'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.277749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ac9ac-6b77-4199-995e-f29b8e7fafba service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:54.279686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6f191494fe413094d28e6a7d39c16b', 'request_id': 'req-e2dea342-2b75-429d-b239-d518f83deeab'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.279952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-619ac9ac-6b77-4199-995e-f29b8e7fafba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:54.295847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ac9ac-6b77-4199-995e-f29b8e7fafba service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:54.349042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:54.355635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] The token cache is being invalidate because project ba6f191494fe413094d28e6a7d39c16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:54.355999 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.356648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-e2dea342-2b75-429d-b239-d518f83deeab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.358281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 977/1958] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:54 2022] DELETE /identity/v3/projects/ba6f191494fe413094d28e6a7d39c16b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:54.360449 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:54.361321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.361783 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.361940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] PATH_INFO: `/v3/projects/9d971232ef7b46598eac20f2819afa34` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.363209 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9b982-29c1-4913-a296-ebf690190ea6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.363335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d971232ef7b46598eac20f2819afa34)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:54.363498 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9b982-29c1-4913-a296-ebf690190ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.363990 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9b982-29c1-4913-a296-ebf690190ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.365939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:54.382514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7ad9b982-29c1-4913-a296-ebf690190ea6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:54.383747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7ad9b982-29c1-4913-a296-ebf690190ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:54.392474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 978/1959] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:54.400870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976c1f-3468-4ac3-b00f-c58c8ee282ad None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.401260 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976c1f-3468-4ac3-b00f-c58c8ee282ad None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.401544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd976c1f-3468-4ac3-b00f-c58c8ee282ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.419928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bd976c1f-3468-4ac3-b00f-c58c8ee282ad None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:54.421203 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bd976c1f-3468-4ac3-b00f-c58c8ee282ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:54.429476 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 979/1960] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:54.434339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd976c1f-3468-4ac3-b00f-c58c8ee282ad None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:54.445114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd976c1f-3468-4ac3-b00f-c58c8ee282ad None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:54.450107 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a23948-6685-456d-9cf5-35137809d469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:54.450809 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a23948-6685-456d-9cf5-35137809d469 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.451047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a23948-6685-456d-9cf5-35137809d469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.451328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a23948-6685-456d-9cf5-35137809d469 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.452111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a23948-6685-456d-9cf5-35137809d469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:54.452429 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a23948-6685-456d-9cf5-35137809d469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:54.454078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a23948-6685-456d-9cf5-35137809d469 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:54.467821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 980/1961] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:13:54.471984 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a23948-6685-456d-9cf5-35137809d469 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:54.482716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a23948-6685-456d-9cf5-35137809d469 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:54.497079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d971232ef7b46598eac20f2819afa34', 'request_id': 'req-1845111c-75c0-4927-adf0-b254e59c7af8'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.551735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d0787-9add-45f6-abf4-ee34d6ec2b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:54.552271 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d0787-9add-45f6-abf4-ee34d6ec2b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.552561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d0787-9add-45f6-abf4-ee34d6ec2b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.552845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d0787-9add-45f6-abf4-ee34d6ec2b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.553551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d0787-9add-45f6-abf4-ee34d6ec2b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:54.556951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d0787-9add-45f6-abf4-ee34d6ec2b0d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:54.581797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d971232ef7b46598eac20f2819afa34', 'request_id': 'req-1845111c-75c0-4927-adf0-b254e59c7af8'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.589018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d971232ef7b46598eac20f2819afa34', 'request_id': 'req-1845111c-75c0-4927-adf0-b254e59c7af8'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.599700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] The token cache is being invalidate because project 9d971232ef7b46598eac20f2819afa34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:54.600065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.600819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.602820 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 982/1962] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:54 2022] DELETE /identity/v3/projects/9d971232ef7b46598eac20f2819afa34 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:54.607731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:54.609691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:54.625018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845111c-75c0-4927-adf0-b254e59c7af8 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:54.629854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:54.630735 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.631023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.631305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] PATH_INFO: `/v3/users/1896262b94ac40d79a0afb8d4288cb54` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.632610 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1896262b94ac40d79a0afb8d4288cb54)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:54.634823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:54.657162 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 981/1963] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:54 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:54.658330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d0787-9add-45f6-abf4-ee34d6ec2b0d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:54.660014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a12d0787-9add-45f6-abf4-ee34d6ec2b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:54.723781 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d0787-9add-45f6-abf4-ee34d6ec2b0d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:54.729061 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30550-f655-422d-86aa-1c66671ed364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:54.730015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30550-f655-422d-86aa-1c66671ed364 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.730348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30550-f655-422d-86aa-1c66671ed364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.730598 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30550-f655-422d-86aa-1c66671ed364 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.731289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e30550-f655-422d-86aa-1c66671ed364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:54.733500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e30550-f655-422d-86aa-1c66671ed364 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:54.800759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1896262b94ac40d79a0afb8d4288cb54'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.812974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1896262b94ac40d79a0afb8d4288cb54'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.813741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1896262b94ac40d79a0afb8d4288cb54'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.822137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 982/1964] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:54 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:54.824132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1896262b94ac40d79a0afb8d4288cb54'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.824333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30550-f655-422d-86aa-1c66671ed364 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:54.825477 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1896262b94ac40d79a0afb8d4288cb54'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:54.826157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a3e30550-f655-422d-86aa-1c66671ed364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:54.838154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30550-f655-422d-86aa-1c66671ed364 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:54.843598 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:54.844450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:54.844738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:54.845016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] PATH_INFO: `/v3/projects/df5147927644488f80d0350633d4126d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:54.846198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5147927644488f80d0350633d4126d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:54.848195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:54.873363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:54.919280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 983/1965] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:54 2022] DELETE /identity/v3/users/1896262b94ac40d79a0afb8d4288cb54 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:54.920396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:54.921726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:54.985551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5147927644488f80d0350633d4126d', 'request_id': 'req-22a0dce8-9842-47d5-958f-a604edd1a4cb'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.002848 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e49ad-e71a-42b4-8ee1-e5d083691539 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:55.013173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5147927644488f80d0350633d4126d', 'request_id': 'req-22a0dce8-9842-47d5-958f-a604edd1a4cb'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.025608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5147927644488f80d0350633d4126d', 'request_id': 'req-22a0dce8-9842-47d5-958f-a604edd1a4cb'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.063212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f23f-4af6-495e-8307-cb22cae2208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:55.063927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f23f-4af6-495e-8307-cb22cae2208b admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.064219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f23f-4af6-495e-8307-cb22cae2208b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.064758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6f23f-4af6-495e-8307-cb22cae2208b admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.065244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6f23f-4af6-495e-8307-cb22cae2208b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:55.066845 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6f23f-4af6-495e-8307-cb22cae2208b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:55.077180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 984/1966] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:55.080844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f23f-4af6-495e-8307-cb22cae2208b admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:55.090609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6f23f-4af6-495e-8307-cb22cae2208b admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:55.095574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f21e9-bb07-4dd2-bf7a-e61178a12004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:55.096784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f21e9-bb07-4dd2-bf7a-e61178a12004 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.096784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f21e9-bb07-4dd2-bf7a-e61178a12004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.096784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f21e9-bb07-4dd2-bf7a-e61178a12004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.097523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f21e9-bb07-4dd2-bf7a-e61178a12004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:55.099160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f21e9-bb07-4dd2-bf7a-e61178a12004 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:55.139645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] The token cache is being invalidate because project df5147927644488f80d0350633d4126d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:55.139645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.139645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.140112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 985/1968] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:55.140217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 983/1968] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:54 2022] DELETE /identity/v3/projects/df5147927644488f80d0350633d4126d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:55.140300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f21e9-bb07-4dd2-bf7a-e61178a12004 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:55.140300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1b8f21e9-bb07-4dd2-bf7a-e61178a12004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:55.143811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:55.145712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:55.156387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f21e9-bb07-4dd2-bf7a-e61178a12004 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:55.162433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:55.167983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.167983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.167983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] PATH_INFO: `/v3/users/25acfd5eecb744608f45a96f752ee6fd` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.168525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0dce8-9842-47d5-958f-a604edd1a4cb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:55.168623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25acfd5eecb744608f45a96f752ee6fd)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:55.171782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1a069-b153-405f-b711-43d123a170ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:55.172761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1a069-b153-405f-b711-43d123a170ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.173118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1a069-b153-405f-b711-43d123a170ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.173469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1a069-b153-405f-b711-43d123a170ae admin admin] PATH_INFO: `/v3/projects/c49aabbf1a0645d095a58c2f76f4702f/users/6ba968017c6d425083177074c47787e1/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.183069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:55.193383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1a069-b153-405f-b711-43d123a170ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49aabbf1a0645d095a58c2f76f4702f, user_id=6ba968017c6d425083177074c47787e1, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:55.199754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1a069-b153-405f-b711-43d123a170ae admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:55.325733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 984/1969] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:55 2022] PUT /identity/v3/projects/c49aabbf1a0645d095a58c2f76f4702f/users/6ba968017c6d425083177074c47787e1/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:55.335762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6bd24-60ec-44a9-a78b-5283d0a2efb7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.336060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6bd24-60ec-44a9-a78b-5283d0a2efb7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.336343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6bd24-60ec-44a9-a78b-5283d0a2efb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.365680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-03e6bd24-60ec-44a9-a78b-5283d0a2efb7 None None] MFA Rules not processed for user `6ba968017c6d425083177074c47787e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:55.366868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-03e6bd24-60ec-44a9-a78b-5283d0a2efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:55.371091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:55.449430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 985/1970] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:55.450430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6bd24-60ec-44a9-a78b-5283d0a2efb7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:55.451937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-03e6bd24-60ec-44a9-a78b-5283d0a2efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:55.476260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25acfd5eecb744608f45a96f752ee6fd'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.490214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25acfd5eecb744608f45a96f752ee6fd'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.490934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25acfd5eecb744608f45a96f752ee6fd'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.498340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25acfd5eecb744608f45a96f752ee6fd'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.498999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25acfd5eecb744608f45a96f752ee6fd'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.523361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6bd24-60ec-44a9-a78b-5283d0a2efb7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:55.528540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:55.529403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.529690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.529971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] PATH_INFO: `/v3/projects/bf389a9776d44ce7bc94d981659581f0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.531190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf389a9776d44ce7bc94d981659581f0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:55.533300 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:55.568522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 986/1971] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:55 2022] DELETE /identity/v3/users/25acfd5eecb744608f45a96f752ee6fd => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:55.569485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:55.570847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:55.641545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f853666-2bbc-4b3d-a917-a86f574dd359 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:55.646156 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8bd1d-1063-473e-93ae-420eb9436eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:55.646826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8bd1d-1063-473e-93ae-420eb9436eef admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.647113 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8bd1d-1063-473e-93ae-420eb9436eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.647390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8bd1d-1063-473e-93ae-420eb9436eef admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.648123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8bd1d-1063-473e-93ae-420eb9436eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:55.650193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8bd1d-1063-473e-93ae-420eb9436eef admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:55.675927 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf389a9776d44ce7bc94d981659581f0', 'request_id': 'req-a63285f5-4cb1-492c-8adb-058824f5c3b1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.681509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf389a9776d44ce7bc94d981659581f0', 'request_id': 'req-a63285f5-4cb1-492c-8adb-058824f5c3b1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.687568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf389a9776d44ce7bc94d981659581f0', 'request_id': 'req-a63285f5-4cb1-492c-8adb-058824f5c3b1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.743782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 987/1972] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:55 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:55.748394 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8bd1d-1063-473e-93ae-420eb9436eef admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:55.760910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:55.766720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] The token cache is being invalidate because project bf389a9776d44ce7bc94d981659581f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:55.767115 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.767847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a63285f5-4cb1-492c-8adb-058824f5c3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:55.773356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 986/1973] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:55 2022] DELETE /identity/v3/projects/bf389a9776d44ce7bc94d981659581f0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:55.774757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39e574-d54b-45c0-a802-b6770d9f597b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.775073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39e574-d54b-45c0-a802-b6770d9f597b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.775430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39e574-d54b-45c0-a802-b6770d9f597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.796172 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-af39e574-d54b-45c0-a802-b6770d9f597b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:55.797774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-af39e574-d54b-45c0-a802-b6770d9f597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:55.823819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8bd1d-1063-473e-93ae-420eb9436eef admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:55.827184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a44f-304e-4c45-b620-97115c4b5d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:55.828064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a44f-304e-4c45-b620-97115c4b5d40 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.828645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a44f-304e-4c45-b620-97115c4b5d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.828765 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a44f-304e-4c45-b620-97115c4b5d40 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.829480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a44f-304e-4c45-b620-97115c4b5d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:55.831474 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a44f-304e-4c45-b620-97115c4b5d40 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:55.864692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 987/1974] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:55.873175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6996ad-6642-4306-87c7-4aeb13c070a8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.873425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6996ad-6642-4306-87c7-4aeb13c070a8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.873741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6996ad-6642-4306-87c7-4aeb13c070a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.895232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8c6996ad-6642-4306-87c7-4aeb13c070a8 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:55.896454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8c6996ad-6642-4306-87c7-4aeb13c070a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:55.905393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 988/1975] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:55.909780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6996ad-6642-4306-87c7-4aeb13c070a8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:55.918614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6996ad-6642-4306-87c7-4aeb13c070a8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:55.923465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77aeaf6-f03e-4f96-bd15-0a3a04061344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:55.924141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aeaf6-f03e-4f96-bd15-0a3a04061344 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.924425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aeaf6-f03e-4f96-bd15-0a3a04061344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.924703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77aeaf6-f03e-4f96-bd15-0a3a04061344 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.925451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77aeaf6-f03e-4f96-bd15-0a3a04061344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:55.925756 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77aeaf6-f03e-4f96-bd15-0a3a04061344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:55.927358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77aeaf6-f03e-4f96-bd15-0a3a04061344 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:55.939208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 989/1976] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:13:55.943730 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77aeaf6-f03e-4f96-bd15-0a3a04061344 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:55.952191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 988/1977] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:55 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:55.954221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77aeaf6-f03e-4f96-bd15-0a3a04061344 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:55.956003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a44f-304e-4c45-b620-97115c4b5d40 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:55.957790 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-88d3a44f-304e-4c45-b620-97115c4b5d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:55.959558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c1b7d-544b-4da4-a5cc-5828e84efb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:55.960236 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1b7d-544b-4da4-a5cc-5828e84efb60 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.960525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1b7d-544b-4da4-a5cc-5828e84efb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.960807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c1b7d-544b-4da4-a5cc-5828e84efb60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.961502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c1b7d-544b-4da4-a5cc-5828e84efb60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:55.964192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c1b7d-544b-4da4-a5cc-5828e84efb60 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:55.970563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a44f-304e-4c45-b620-97115c4b5d40 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:55.975824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06648f3c-b280-40c7-99e3-dfc27492d6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:55.976420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06648f3c-b280-40c7-99e3-dfc27492d6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:55.976712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06648f3c-b280-40c7-99e3-dfc27492d6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:55.977026 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06648f3c-b280-40c7-99e3-dfc27492d6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:55.977993 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06648f3c-b280-40c7-99e3-dfc27492d6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:55.980662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06648f3c-b280-40c7-99e3-dfc27492d6ef admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:55.990954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 989/1978] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:55.995330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06648f3c-b280-40c7-99e3-dfc27492d6ef admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.004806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06648f3c-b280-40c7-99e3-dfc27492d6ef admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.009617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ff0b1-7e2d-4a70-b4aa-1a5752519b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.010376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff0b1-7e2d-4a70-b4aa-1a5752519b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.010666 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff0b1-7e2d-4a70-b4aa-1a5752519b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.011121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ff0b1-7e2d-4a70-b4aa-1a5752519b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.011868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ff0b1-7e2d-4a70-b4aa-1a5752519b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.013464 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ff0b1-7e2d-4a70-b4aa-1a5752519b9d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.023795 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 990/1979] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:13:56.028586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ff0b1-7e2d-4a70-b4aa-1a5752519b9d admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.037967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ff0b1-7e2d-4a70-b4aa-1a5752519b9d admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.043772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc564e-bf51-4b93-b68e-bce2b1ed9049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.044624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc564e-bf51-4b93-b68e-bce2b1ed9049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.044919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc564e-bf51-4b93-b68e-bce2b1ed9049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.045199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc564e-bf51-4b93-b68e-bce2b1ed9049 admin admin] PATH_INFO: `/v3/projects/c8d10d21147c4c1eb1ce4315fca0ee85/users/836c76d03b1f4e0a8417ba7e2ffc3f91/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.061678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc564e-bf51-4b93-b68e-bce2b1ed9049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d10d21147c4c1eb1ce4315fca0ee85, user_id=836c76d03b1f4e0a8417ba7e2ffc3f91, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.064403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc564e-bf51-4b93-b68e-bce2b1ed9049 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.077281 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 990/1980] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:55 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:13:56.078278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c1b7d-544b-4da4-a5cc-5828e84efb60 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.080108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1d1c1b7d-544b-4da4-a5cc-5828e84efb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:56.142522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c1b7d-544b-4da4-a5cc-5828e84efb60 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.147062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.147972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.148244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.148527 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] PATH_INFO: `/v3/projects/3cdbd402ba8840319f70cda96bd4fb00` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.149716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cdbd402ba8840319f70cda96bd4fb00)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.152175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.182117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 991/1981] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:56 2022] PUT /identity/v3/projects/c8d10d21147c4c1eb1ce4315fca0ee85/users/836c76d03b1f4e0a8417ba7e2ffc3f91/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:56.190290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc564e-bf51-4b93-b68e-bce2b1ed9049 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.249204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc564e-bf51-4b93-b68e-bce2b1ed9049 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.251824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cdbd402ba8840319f70cda96bd4fb00', 'request_id': 'req-548f59fa-112a-4600-bd6b-26d8862da84c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:56.258211 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cdbd402ba8840319f70cda96bd4fb00', 'request_id': 'req-548f59fa-112a-4600-bd6b-26d8862da84c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:56.266514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cdbd402ba8840319f70cda96bd4fb00', 'request_id': 'req-548f59fa-112a-4600-bd6b-26d8862da84c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:56.308979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e2b68-c27a-487d-b7f7-cba78d201c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.309654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2b68-c27a-487d-b7f7-cba78d201c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.309936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2b68-c27a-487d-b7f7-cba78d201c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.310211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e2b68-c27a-487d-b7f7-cba78d201c02 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.310939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e2b68-c27a-487d-b7f7-cba78d201c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.312914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e2b68-c27a-487d-b7f7-cba78d201c02 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.328457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] The token cache is being invalidate because project 3cdbd402ba8840319f70cda96bd4fb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:56.328888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:56.329425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-548f59fa-112a-4600-bd6b-26d8862da84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:56.330997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 991/1982] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:56 2022] DELETE /identity/v3/projects/3cdbd402ba8840319f70cda96bd4fb00 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:56.332483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070e126-7a6e-4adc-a1c4-0a84d984f14e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.332988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070e126-7a6e-4adc-a1c4-0a84d984f14e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.333441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070e126-7a6e-4adc-a1c4-0a84d984f14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.335970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:56.361891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1070e126-7a6e-4adc-a1c4-0a84d984f14e None None] MFA Rules not processed for user `836c76d03b1f4e0a8417ba7e2ffc3f91`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:56.363094 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1070e126-7a6e-4adc-a1c4-0a84d984f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:56.426344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 992/1983] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:56.427522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494b3c8-70ac-45b1-bede-81f3c8152fa4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.427843 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494b3c8-70ac-45b1-bede-81f3c8152fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.428123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494b3c8-70ac-45b1-bede-81f3c8152fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.440145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 992/1984] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:56 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:56.442081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e2b68-c27a-487d-b7f7-cba78d201c02 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.447190 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-446e2b68-c27a-487d-b7f7-cba78d201c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:56.451058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7494b3c8-70ac-45b1-bede-81f3c8152fa4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:56.452291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7494b3c8-70ac-45b1-bede-81f3c8152fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:56.463131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 993/1985] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:56.463131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494b3c8-70ac-45b1-bede-81f3c8152fa4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.463510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e2b68-c27a-487d-b7f7-cba78d201c02 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.464050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7494b3c8-70ac-45b1-bede-81f3c8152fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:56.473672 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245741f-286d-4d36-9665-935145077598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.474365 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245741f-286d-4d36-9665-935145077598 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.474644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245741f-286d-4d36-9665-935145077598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.474924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245741f-286d-4d36-9665-935145077598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.475663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245741f-286d-4d36-9665-935145077598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.476288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494b3c8-70ac-45b1-bede-81f3c8152fa4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.477574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245741f-286d-4d36-9665-935145077598 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.482287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227ee51-e00a-46d6-844c-b144bb5956f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.482947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ee51-e00a-46d6-844c-b144bb5956f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.483231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ee51-e00a-46d6-844c-b144bb5956f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.483510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ee51-e00a-46d6-844c-b144bb5956f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.484277 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227ee51-e00a-46d6-844c-b144bb5956f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.486022 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227ee51-e00a-46d6-844c-b144bb5956f4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.497217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 994/1986] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:56.498493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0faa-3223-45cc-94ab-8b71e0d3aefc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.498779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0faa-3223-45cc-94ab-8b71e0d3aefc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.499094 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0faa-3223-45cc-94ab-8b71e0d3aefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.516983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-89cd0faa-3223-45cc-94ab-8b71e0d3aefc None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:56.518189 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-89cd0faa-3223-45cc-94ab-8b71e0d3aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:56.526198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 995/1987] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:56.527108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd0faa-3223-45cc-94ab-8b71e0d3aefc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.537404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd0faa-3223-45cc-94ab-8b71e0d3aefc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.542744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166679f-28a8-43f0-a85c-6eee1cc88ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.543377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166679f-28a8-43f0-a85c-6eee1cc88ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.543701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166679f-28a8-43f0-a85c-6eee1cc88ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.544000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166679f-28a8-43f0-a85c-6eee1cc88ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.544736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166679f-28a8-43f0-a85c-6eee1cc88ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.546359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166679f-28a8-43f0-a85c-6eee1cc88ec5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.556149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 996/1988] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:56.557626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166679f-28a8-43f0-a85c-6eee1cc88ec5 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.566825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166679f-28a8-43f0-a85c-6eee1cc88ec5 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.571423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f38a66-7b4e-4b7f-b759-94227ef7cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.572073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f38a66-7b4e-4b7f-b759-94227ef7cc44 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.572357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f38a66-7b4e-4b7f-b759-94227ef7cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.572942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f38a66-7b4e-4b7f-b759-94227ef7cc44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.573561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f38a66-7b4e-4b7f-b759-94227ef7cc44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:56.573877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f38a66-7b4e-4b7f-b759-94227ef7cc44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.575571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f38a66-7b4e-4b7f-b759-94227ef7cc44 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.587674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 997/1989] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:13:56.589170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f38a66-7b4e-4b7f-b759-94227ef7cc44 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.593340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 993/1990] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:56 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:56.594103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245741f-286d-4d36-9665-935145077598 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.601110 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f38a66-7b4e-4b7f-b759-94227ef7cc44 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.655559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245741f-286d-4d36-9665-935145077598 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.657200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea788e-b971-490f-b8fe-6cba66b29ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.658123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea788e-b971-490f-b8fe-6cba66b29ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.658411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea788e-b971-490f-b8fe-6cba66b29ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.658690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea788e-b971-490f-b8fe-6cba66b29ad6 admin admin] PATH_INFO: `/v3/projects/8141e4ae9cbd41288674f4b4ab96d586/users/8ffa9d126ec4474093eb1c48afb95bab/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.660304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d87460-21ae-4bbd-8280-b9d8afac4dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.660964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d87460-21ae-4bbd-8280-b9d8afac4dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.661245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d87460-21ae-4bbd-8280-b9d8afac4dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.661517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d87460-21ae-4bbd-8280-b9d8afac4dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.666903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d87460-21ae-4bbd-8280-b9d8afac4dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.666903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d87460-21ae-4bbd-8280-b9d8afac4dc7 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.675261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea788e-b971-490f-b8fe-6cba66b29ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8141e4ae9cbd41288674f4b4ab96d586, user_id=8ffa9d126ec4474093eb1c48afb95bab, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.678270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea788e-b971-490f-b8fe-6cba66b29ad6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.739760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 998/1991] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:56 2022] PUT /identity/v3/projects/8141e4ae9cbd41288674f4b4ab96d586/users/8ffa9d126ec4474093eb1c48afb95bab/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:56.740594 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea788e-b971-490f-b8fe-6cba66b29ad6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.769808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 994/1992] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:56 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:56.769808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4d295-93ff-42cd-a64d-6c2ad655d75c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.769808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4d295-93ff-42cd-a64d-6c2ad655d75c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.769808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4d295-93ff-42cd-a64d-6c2ad655d75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.798236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-12c4d295-93ff-42cd-a64d-6c2ad655d75c None None] MFA Rules not processed for user `8ffa9d126ec4474093eb1c48afb95bab`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:56.799489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-12c4d295-93ff-42cd-a64d-6c2ad655d75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:56.808811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea788e-b971-490f-b8fe-6cba66b29ad6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.868468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 995/1993] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:56.873181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4d295-93ff-42cd-a64d-6c2ad655d75c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.876275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b77be-84d4-4be1-bc66-fd65bb790f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.878063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b77be-84d4-4be1-bc66-fd65bb790f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.878188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b77be-84d4-4be1-bc66-fd65bb790f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.878561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b77be-84d4-4be1-bc66-fd65bb790f05 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.879366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b77be-84d4-4be1-bc66-fd65bb790f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.881422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b77be-84d4-4be1-bc66-fd65bb790f05 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.889762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4d295-93ff-42cd-a64d-6c2ad655d75c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.894400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98e9f3-0312-4abc-ba96-7a54f86a2fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.895061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98e9f3-0312-4abc-ba96-7a54f86a2fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.896124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98e9f3-0312-4abc-ba96-7a54f86a2fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.896124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98e9f3-0312-4abc-ba96-7a54f86a2fe0 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.896451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98e9f3-0312-4abc-ba96-7a54f86a2fe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.898277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98e9f3-0312-4abc-ba96-7a54f86a2fe0 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:56.973514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 996/1994] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:56 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:56.974810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 999/1995] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:56 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:56.977177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98e9f3-0312-4abc-ba96-7a54f86a2fe0 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.978806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ca98e9f3-0312-4abc-ba96-7a54f86a2fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:56.978924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b77be-84d4-4be1-bc66-fd65bb790f05 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:56.989039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b77be-84d4-4be1-bc66-fd65bb790f05 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:56.993711 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd7947-b942-407e-93b2-8a47a4fd1fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:56.994908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd7947-b942-407e-93b2-8a47a4fd1fda admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:56.995287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd7947-b942-407e-93b2-8a47a4fd1fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:56.995521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd7947-b942-407e-93b2-8a47a4fd1fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:56.996289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd7947-b942-407e-93b2-8a47a4fd1fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:56.997895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd7947-b942-407e-93b2-8a47a4fd1fda admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.007933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1000/1996] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:57.007933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd7947-b942-407e-93b2-8a47a4fd1fda admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.019682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd7947-b942-407e-93b2-8a47a4fd1fda admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.024486 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a22fd-3b89-402a-be31-76fe0c5a7794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.025136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a22fd-3b89-402a-be31-76fe0c5a7794 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.025424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a22fd-3b89-402a-be31-76fe0c5a7794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.025790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a22fd-3b89-402a-be31-76fe0c5a7794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.026710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a22fd-3b89-402a-be31-76fe0c5a7794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.028373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a22fd-3b89-402a-be31-76fe0c5a7794 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.036124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98e9f3-0312-4abc-ba96-7a54f86a2fe0 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.039075 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1001/1997] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:57.039882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d8fd-ab9a-45ce-8150-647f44911662 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d089c711a94b70a198e35443ee7ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.039994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a22fd-3b89-402a-be31-76fe0c5a7794 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.040530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d8fd-ab9a-45ce-8150-647f44911662 service glance] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.040811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d8fd-ab9a-45ce-8150-647f44911662 service glance] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.041088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d8fd-ab9a-45ce-8150-647f44911662 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.049695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a22fd-3b89-402a-be31-76fe0c5a7794 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.049837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760d8fd-ab9a-45ce-8150-647f44911662 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.051123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760d8fd-ab9a-45ce-8150-647f44911662 service glance] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.054434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ebc4-92c3-4d2b-a80d-e86d514a6e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.055020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ebc4-92c3-4d2b-a80d-e86d514a6e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.055818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ebc4-92c3-4d2b-a80d-e86d514a6e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.055818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ebc4-92c3-4d2b-a80d-e86d514a6e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.056352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7ebc4-92c3-4d2b-a80d-e86d514a6e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.058453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7ebc4-92c3-4d2b-a80d-e86d514a6e21 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.060590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 997/1998] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:57.061400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d8fd-ab9a-45ce-8150-647f44911662 service glance] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.070539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1002/1999] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:57.071842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d8fd-ab9a-45ce-8150-647f44911662 service glance] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.076065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ebc4-92c3-4d2b-a80d-e86d514a6e21 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.079264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a15461-a048-407b-b902-13cccab1f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.080251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a15461-a048-407b-b902-13cccab1f84d admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.080650 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a15461-a048-407b-b902-13cccab1f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.080931 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a15461-a048-407b-b902-13cccab1f84d admin admin] PATH_INFO: `/v3/projects/71a4657d359f419fab7f0c6ef2fd3ed5/users/ac23e931538243868458435b05da9f82/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.086621 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ebc4-92c3-4d2b-a80d-e86d514a6e21 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.091962 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6baed-7102-47a3-81c9-46d4daee71e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.092856 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6baed-7102-47a3-81c9-46d4daee71e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.093145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6baed-7102-47a3-81c9-46d4daee71e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.093429 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6baed-7102-47a3-81c9-46d4daee71e0 admin admin] PATH_INFO: `/v3/projects/81e6565cae614f32a2f557c26eeefa58/users/2629f469439a4ceb8c419afa37c930a8/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.104966 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a15461-a048-407b-b902-13cccab1f84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a4657d359f419fab7f0c6ef2fd3ed5, user_id=ac23e931538243868458435b05da9f82, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.108135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a15461-a048-407b-b902-13cccab1f84d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.111266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6baed-7102-47a3-81c9-46d4daee71e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e6565cae614f32a2f557c26eeefa58, user_id=2629f469439a4ceb8c419afa37c930a8, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.114059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6baed-7102-47a3-81c9-46d4daee71e0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.195071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 998/2001] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:57 2022] PUT /identity/v3/projects/71a4657d359f419fab7f0c6ef2fd3ed5/users/ac23e931538243868458435b05da9f82/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:57.199728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a15461-a048-407b-b902-13cccab1f84d admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.203944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1003/2001] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:57 2022] PUT /identity/v3/projects/81e6565cae614f32a2f557c26eeefa58/users/2629f469439a4ceb8c419afa37c930a8/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:57.205878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ab9a-91b2-4078-9cfc-63b4e35cc37d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.206207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ab9a-91b2-4078-9cfc-63b4e35cc37d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.206467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ab9a-91b2-4078-9cfc-63b4e35cc37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.235354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1ab1ab9a-91b2-4078-9cfc-63b4e35cc37d None None] MFA Rules not processed for user `2629f469439a4ceb8c419afa37c930a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:57.239323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1ab1ab9a-91b2-4078-9cfc-63b4e35cc37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:57.272964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a15461-a048-407b-b902-13cccab1f84d admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.278970 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77a46-2201-4b00-ae03-c8b180b70eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.280088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77a46-2201-4b00-ae03-c8b180b70eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.280436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77a46-2201-4b00-ae03-c8b180b70eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.280658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b77a46-2201-4b00-ae03-c8b180b70eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.282275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b77a46-2201-4b00-ae03-c8b180b70eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.283919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b77a46-2201-4b00-ae03-c8b180b70eb2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.294657 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 999/2002] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:57.298737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77a46-2201-4b00-ae03-c8b180b70eb2 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.310207 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b77a46-2201-4b00-ae03-c8b180b70eb2 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.313187 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1004/2003] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:57.313929 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:57.318397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6ed04-19d2-4e55-8eef-20e9a450bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.319335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6ed04-19d2-4e55-8eef-20e9a450bb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.319683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6ed04-19d2-4e55-8eef-20e9a450bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.320015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6ed04-19d2-4e55-8eef-20e9a450bb06 admin admin] PATH_INFO: `/v3/projects/71a4657d359f419fab7f0c6ef2fd3ed5/users/ac23e931538243868458435b05da9f82/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.324046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1ab9a-91b2-4078-9cfc-63b4e35cc37d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.324194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6ed04-19d2-4e55-8eef-20e9a450bb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a4657d359f419fab7f0c6ef2fd3ed5, user_id=ac23e931538243868458435b05da9f82, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.327173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6ed04-19d2-4e55-8eef-20e9a450bb06 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.340439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1ab9a-91b2-4078-9cfc-63b4e35cc37d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.346549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1000/2004] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:57 2022] PUT /identity/v3/projects/71a4657d359f419fab7f0c6ef2fd3ed5/users/ac23e931538243868458435b05da9f82/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:57.358678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9059-e27a-49aa-ab4a-65ad18d146c4 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.358970 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9059-e27a-49aa-ab4a-65ad18d146c4 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.359254 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9059-e27a-49aa-ab4a-65ad18d146c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.376227 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:57.401362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-805f9059-e27a-49aa-ab4a-65ad18d146c4 None None] MFA Rules not processed for user `ac23e931538243868458435b05da9f82`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:57.402614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-805f9059-e27a-49aa-ab4a-65ad18d146c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:57.415685 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104a445-a9f8-4064-896f-e5579a167187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.417261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104a445-a9f8-4064-896f-e5579a167187 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.417727 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104a445-a9f8-4064-896f-e5579a167187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.418153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104a445-a9f8-4064-896f-e5579a167187 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.418989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104a445-a9f8-4064-896f-e5579a167187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.421120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104a445-a9f8-4064-896f-e5579a167187 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.479595 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1001/2005] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:57.491373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9059-e27a-49aa-ab4a-65ad18d146c4 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.493021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-805f9059-e27a-49aa-ab4a-65ad18d146c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:57.519141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1005/2006] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:57 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:57.523268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104a445-a9f8-4064-896f-e5579a167187 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.551645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9059-e27a-49aa-ab4a-65ad18d146c4 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.590491 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104a445-a9f8-4064-896f-e5579a167187 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.595529 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bd598-455d-4e65-a3c5-811961bf524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.596343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd598-455d-4e65-a3c5-811961bf524d admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.596735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd598-455d-4e65-a3c5-811961bf524d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.597244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd598-455d-4e65-a3c5-811961bf524d admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.598066 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bd598-455d-4e65-a3c5-811961bf524d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.600263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bd598-455d-4e65-a3c5-811961bf524d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.601865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefdff5-d967-4187-883e-4b6b7114c3f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.602523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefdff5-d967-4187-883e-4b6b7114c3f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.602815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefdff5-d967-4187-883e-4b6b7114c3f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.603164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefdff5-d967-4187-883e-4b6b7114c3f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.605414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-2eefdff5-d967-4187-883e-4b6b7114c3f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:57.663468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefdff5-d967-4187-883e-4b6b7114c3f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.664982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefdff5-d967-4187-883e-4b6b7114c3f2 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.674122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1002/2007] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:57.694909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1006/2008] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:13:57 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:13:57.696150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefdff5-d967-4187-883e-4b6b7114c3f2 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.707509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefdff5-d967-4187-883e-4b6b7114c3f2 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.712486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab0c02-a3f0-4cce-9ca8-df757b32aaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.713261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab0c02-a3f0-4cce-9ca8-df757b32aaeb admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.713587 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab0c02-a3f0-4cce-9ca8-df757b32aaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.713945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab0c02-a3f0-4cce-9ca8-df757b32aaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.714622 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab0c02-a3f0-4cce-9ca8-df757b32aaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.716240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab0c02-a3f0-4cce-9ca8-df757b32aaeb admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.729638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1003/2009] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:57.730728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bd598-455d-4e65-a3c5-811961bf524d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.741273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bd598-455d-4e65-a3c5-811961bf524d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.746855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdf1c1-c636-4a8c-bb54-3a703b6686f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.747848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf1c1-c636-4a8c-bb54-3a703b6686f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.748172 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf1c1-c636-4a8c-bb54-3a703b6686f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.748455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf1c1-c636-4a8c-bb54-3a703b6686f4 admin admin] PATH_INFO: `/v3/projects/bfb786db1b9a4c3e819caed3bbc7d203/users/528cd7bb98a34db1bb5b8afd2c539273/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.764577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdf1c1-c636-4a8c-bb54-3a703b6686f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb786db1b9a4c3e819caed3bbc7d203, user_id=528cd7bb98a34db1bb5b8afd2c539273, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.767392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cdf1c1-c636-4a8c-bb54-3a703b6686f4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.871724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1007/2010] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:57 2022] PUT /identity/v3/projects/bfb786db1b9a4c3e819caed3bbc7d203/users/528cd7bb98a34db1bb5b8afd2c539273/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:57.875929 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab0c02-a3f0-4cce-9ca8-df757b32aaeb admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.886638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab0c02-a3f0-4cce-9ca8-df757b32aaeb admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.944036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdf1c1-c636-4a8c-bb54-3a703b6686f4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.945925 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d7cdf1c1-c636-4a8c-bb54-3a703b6686f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:57.958870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b9c8b-1645-469d-b30c-e084d821d353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.959691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9c8b-1645-469d-b30c-e084d821d353 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.959989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9c8b-1645-469d-b30c-e084d821d353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.960322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9c8b-1645-469d-b30c-e084d821d353 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.961372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b9c8b-1645-469d-b30c-e084d821d353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:57.962994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b9c8b-1645-469d-b30c-e084d821d353 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:57.977591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1004/2011] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:13:57.979915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b9c8b-1645-469d-b30c-e084d821d353 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:57.990707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b9c8b-1645-469d-b30c-e084d821d353 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:57.996091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dab41c-4dbe-4f19-8374-4c829a2a3836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:57.997004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dab41c-4dbe-4f19-8374-4c829a2a3836 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:57.997292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dab41c-4dbe-4f19-8374-4c829a2a3836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:57.998537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dab41c-4dbe-4f19-8374-4c829a2a3836 admin admin] PATH_INFO: `/v3/projects/bfb786db1b9a4c3e819caed3bbc7d203/users/528cd7bb98a34db1bb5b8afd2c539273/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:57.999769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dab41c-4dbe-4f19-8374-4c829a2a3836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb786db1b9a4c3e819caed3bbc7d203, user_id=528cd7bb98a34db1bb5b8afd2c539273, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:58.002398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dab41c-4dbe-4f19-8374-4c829a2a3836 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:58.021420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1005/2012] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:13:57 2022] PUT /identity/v3/projects/bfb786db1b9a4c3e819caed3bbc7d203/users/528cd7bb98a34db1bb5b8afd2c539273/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:58.028424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdf1c1-c636-4a8c-bb54-3a703b6686f4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:58.033323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc256-b594-4f18-ab99-94cec77ffdd2 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:58.033687 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc256-b594-4f18-ab99-94cec77ffdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:58.034060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc256-b594-4f18-ab99-94cec77ffdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:58.066333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-bc2fc256-b594-4f18-ab99-94cec77ffdd2 None None] MFA Rules not processed for user `528cd7bb98a34db1bb5b8afd2c539273`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:58.067806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-bc2fc256-b594-4f18-ab99-94cec77ffdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:58.094535 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590634f-24ec-44d0-b701-1ad83fb98546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:58.095435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590634f-24ec-44d0-b701-1ad83fb98546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:58.095752 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590634f-24ec-44d0-b701-1ad83fb98546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:58.096044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590634f-24ec-44d0-b701-1ad83fb98546 admin admin] PATH_INFO: `/v3/users/8fa7313f44374d5aae99c9f52daf7253` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:58.097282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590634f-24ec-44d0-b701-1ad83fb98546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fa7313f44374d5aae99c9f52daf7253)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:58.099209 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590634f-24ec-44d0-b701-1ad83fb98546 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:58.142368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1006/2013] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:58.155626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fc256-b594-4f18-ab99-94cec77ffdd2 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:58.157010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-bc2fc256-b594-4f18-ab99-94cec77ffdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:58.215102 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fc256-b594-4f18-ab99-94cec77ffdd2 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:58.218862 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f066ed-9de9-4ea5-b1d0-505abf0c9ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:58.219509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f066ed-9de9-4ea5-b1d0-505abf0c9ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:58.219843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f066ed-9de9-4ea5-b1d0-505abf0c9ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:58.220126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f066ed-9de9-4ea5-b1d0-505abf0c9ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:58.229563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f066ed-9de9-4ea5-b1d0-505abf0c9ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:58.231088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f066ed-9de9-4ea5-b1d0-505abf0c9ac0 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:58.240891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1007/2014] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:58.242770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:58.269703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2590634f-24ec-44d0-b701-1ad83fb98546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fa7313f44374d5aae99c9f52daf7253'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:58.296104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:58.329145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f066ed-9de9-4ea5-b1d0-505abf0c9ac0 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:58.339843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f066ed-9de9-4ea5-b1d0-505abf0c9ac0 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:58.344727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:58.345584 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:58.345868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:58.346144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] PATH_INFO: `/v3/users/2629f469439a4ceb8c419afa37c930a8` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:58.347348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2629f469439a4ceb8c419afa37c930a8)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:58.349356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:58.350181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2590634f-24ec-44d0-b701-1ad83fb98546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fa7313f44374d5aae99c9f52daf7253'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:58.364314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2590634f-24ec-44d0-b701-1ad83fb98546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fa7313f44374d5aae99c9f52daf7253'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:58.365001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2590634f-24ec-44d0-b701-1ad83fb98546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fa7313f44374d5aae99c9f52daf7253'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:58.365777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2590634f-24ec-44d0-b701-1ad83fb98546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fa7313f44374d5aae99c9f52daf7253'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:58.381394 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1008/2015] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:57 2022] DELETE /identity/v3/users/8fa7313f44374d5aae99c9f52daf7253 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:58.386840 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4536694-97ef-4bfa-a2a2-26da43005444 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:58.388563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4536694-97ef-4bfa-a2a2-26da43005444 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:58.388563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4536694-97ef-4bfa-a2a2-26da43005444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:58.407876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d4536694-97ef-4bfa-a2a2-26da43005444 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:58.410028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d4536694-97ef-4bfa-a2a2-26da43005444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:58.473622 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1009/2016] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:58.483613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4536694-97ef-4bfa-a2a2-26da43005444 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:58.484894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d4536694-97ef-4bfa-a2a2-26da43005444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:58.555728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4536694-97ef-4bfa-a2a2-26da43005444 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:58.560514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9addfe-8078-43c1-bfd8-e5b968ec413c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:58.561172 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9addfe-8078-43c1-bfd8-e5b968ec413c service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:58.561537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9addfe-8078-43c1-bfd8-e5b968ec413c service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:58.561799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9addfe-8078-43c1-bfd8-e5b968ec413c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:58.569555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2629f469439a4ceb8c419afa37c930a8'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:58.574728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9addfe-8078-43c1-bfd8-e5b968ec413c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:58.577154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9addfe-8078-43c1-bfd8-e5b968ec413c service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:58.589553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2629f469439a4ceb8c419afa37c930a8'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:58.590364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2629f469439a4ceb8c419afa37c930a8'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:58.590674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1010/2017] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:58.599519 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2629f469439a4ceb8c419afa37c930a8'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:58.600305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2629f469439a4ceb8c419afa37c930a8'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:58.702772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1008/2018] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:58 2022] DELETE /identity/v3/users/2629f469439a4ceb8c419afa37c930a8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:58.707550 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb549c-2715-4baf-b355-fa7eb1800ef4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:58.707881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb549c-2715-4baf-b355-fa7eb1800ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:58.708200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb549c-2715-4baf-b355-fa7eb1800ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:58.727686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-84cb549c-2715-4baf-b355-fa7eb1800ef4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:58.728825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-84cb549c-2715-4baf-b355-fa7eb1800ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:58.779138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:INSERT=2,keystone:SELECT=96,keystone:DELETE=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:58.795054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1011/2019] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:13:58.804756 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:58.806207 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:58.840557 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:58.873779 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa26a3c-d54d-40ae-b06f-97f34dcd88e1 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:58.878235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048542f2-8f1d-4d43-8f27-7104dff2afa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:58.878907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048542f2-8f1d-4d43-8f27-7104dff2afa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:58.879196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048542f2-8f1d-4d43-8f27-7104dff2afa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:58.879478 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048542f2-8f1d-4d43-8f27-7104dff2afa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:58.890337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048542f2-8f1d-4d43-8f27-7104dff2afa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:58.891835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048542f2-8f1d-4d43-8f27-7104dff2afa8 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:58.902272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1009/2020] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:13:59.157115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:59.163739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb549c-2715-4baf-b355-fa7eb1800ef4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:59.165202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-84cb549c-2715-4baf-b355-fa7eb1800ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:59.188160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb549c-2715-4baf-b355-fa7eb1800ef4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:59.193211 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:59.194202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:59.194390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:59.194674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] PATH_INFO: `/v3/projects/43dff609016148a4b8621ca2083b81b4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:59.196051 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=43dff609016148a4b8621ca2083b81b4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:59.198082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:59.251389 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:59.343727 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43dff609016148a4b8621ca2083b81b4', 'request_id': 'req-53d8e990-c2b7-403e-8aff-f949018171fe'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:59.349210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43dff609016148a4b8621ca2083b81b4', 'request_id': 'req-53d8e990-c2b7-403e-8aff-f949018171fe'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:59.356396 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43dff609016148a4b8621ca2083b81b4', 'request_id': 'req-53d8e990-c2b7-403e-8aff-f949018171fe'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:59.424706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048542f2-8f1d-4d43-8f27-7104dff2afa8 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:59.427403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-048542f2-8f1d-4d43-8f27-7104dff2afa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:59.450854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] The token cache is being invalidate because project 43dff609016148a4b8621ca2083b81b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:59.451511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:59.452914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53d8e990-c2b7-403e-8aff-f949018171fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:59.453804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048542f2-8f1d-4d43-8f27-7104dff2afa8 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:59.458410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1012/2021] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:59 2022] DELETE /identity/v3/projects/43dff609016148a4b8621ca2083b81b4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:13:59.460255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88137c-e8a8-4dbd-91a5-c64482c09947 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:59.460695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88137c-e8a8-4dbd-91a5-c64482c09947 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:59.461056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88137c-e8a8-4dbd-91a5-c64482c09947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:59.481894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ba88137c-e8a8-4dbd-91a5-c64482c09947 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:59.483310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ba88137c-e8a8-4dbd-91a5-c64482c09947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:59.517775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:59.518819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:59.519107 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:59.519379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] PATH_INFO: `/v3/projects/81e6565cae614f32a2f557c26eeefa58` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:59.520648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e6565cae614f32a2f557c26eeefa58)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:59.522655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:59.553591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1013/2022] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:59.563228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93111c68-9531-479e-8e9c-28d71fcca1fa None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:59.563228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93111c68-9531-479e-8e9c-28d71fcca1fa None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:59.563228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93111c68-9531-479e-8e9c-28d71fcca1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:59.583981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-93111c68-9531-479e-8e9c-28d71fcca1fa None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:13:59.585203 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-93111c68-9531-479e-8e9c-28d71fcca1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:59.594425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1014/2023] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:13:59.598553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93111c68-9531-479e-8e9c-28d71fcca1fa None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:59.608422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93111c68-9531-479e-8e9c-28d71fcca1fa None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:59.615732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2180c-e667-4c32-957a-bbfcc38666a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:59.615732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2180c-e667-4c32-957a-bbfcc38666a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:59.615732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2180c-e667-4c32-957a-bbfcc38666a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:59.615732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2180c-e667-4c32-957a-bbfcc38666a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:59.629944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2180c-e667-4c32-957a-bbfcc38666a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:13:59.629944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2180c-e667-4c32-957a-bbfcc38666a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:59.629944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2180c-e667-4c32-957a-bbfcc38666a1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:59.630604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1015/2024] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:13:59.631461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2180c-e667-4c32-957a-bbfcc38666a1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:59.633137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e2b2180c-e667-4c32-957a-bbfcc38666a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:59.665430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:59.673715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e6565cae614f32a2f557c26eeefa58', 'request_id': 'req-4904c3af-159e-4bcc-8eed-08b55987ffb0'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:59.693262 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2180c-e667-4c32-957a-bbfcc38666a1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:59.742407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523fd97-322e-428e-adc1-6336134e9b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:59.743187 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523fd97-322e-428e-adc1-6336134e9b2a service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:59.743525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523fd97-322e-428e-adc1-6336134e9b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:59.744169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523fd97-322e-428e-adc1-6336134e9b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:59.748192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:59.754314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9523fd97-322e-428e-adc1-6336134e9b2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:59.756030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e6565cae614f32a2f557c26eeefa58', 'request_id': 'req-4904c3af-159e-4bcc-8eed-08b55987ffb0'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:59.764683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e6565cae614f32a2f557c26eeefa58', 'request_id': 'req-4904c3af-159e-4bcc-8eed-08b55987ffb0'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:59.778301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] The token cache is being invalidate because project 81e6565cae614f32a2f557c26eeefa58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:13:59.778654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:59.779465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:13:59.781039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1010/2025] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:13:59 2022] DELETE /identity/v3/projects/81e6565cae614f32a2f557c26eeefa58 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:13:59.783511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:59.783511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:59.819085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523fd97-322e-428e-adc1-6336134e9b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:59.820793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9523fd97-322e-428e-adc1-6336134e9b2a service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:59.833041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1016/2026] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:13:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:13:59.834722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523fd97-322e-428e-adc1-6336134e9b2a service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:13:59.837573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9523fd97-322e-428e-adc1-6336134e9b2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:13:59.892043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904c3af-159e-4bcc-8eed-08b55987ffb0 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:59.899911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c6209-a264-4e9b-b374-55f86e7a519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:59.901011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c6209-a264-4e9b-b374-55f86e7a519e admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:59.901568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c6209-a264-4e9b-b374-55f86e7a519e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:59.901868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c6209-a264-4e9b-b374-55f86e7a519e admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:59.904109 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c6209-a264-4e9b-b374-55f86e7a519e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:59.906373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c6209-a264-4e9b-b374-55f86e7a519e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:13:59.945642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523fd97-322e-428e-adc1-6336134e9b2a service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:13:59.950899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:13:59.951313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:13:59.951968 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:13:59.952310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:13:59.959771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] PATH_INFO: `/v3/users/528cd7bb98a34db1bb5b8afd2c539273` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:13:59.959771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=528cd7bb98a34db1bb5b8afd2c539273)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:13:59.959771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:00.037581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1011/2027] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:13:59 2022] POST /identity/v3/projects => generated 397 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:00.043351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c6209-a264-4e9b-b374-55f86e7a519e admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:00.053838 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:00.125041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c6209-a264-4e9b-b374-55f86e7a519e admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:00.132766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899226e-e33a-4321-9190-2714b4c8f96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:00.133742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899226e-e33a-4321-9190-2714b4c8f96f admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:00.134026 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899226e-e33a-4321-9190-2714b4c8f96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:00.134555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899226e-e33a-4321-9190-2714b4c8f96f admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:00.136152 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899226e-e33a-4321-9190-2714b4c8f96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:00.138323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899226e-e33a-4321-9190-2714b4c8f96f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:00.142723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '528cd7bb98a34db1bb5b8afd2c539273'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:00.204297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '528cd7bb98a34db1bb5b8afd2c539273'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:00.214238 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1012/2028] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:00 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:00.215087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899226e-e33a-4321-9190-2714b4c8f96f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:00.219207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '528cd7bb98a34db1bb5b8afd2c539273'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:00.220055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '528cd7bb98a34db1bb5b8afd2c539273'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:00.220766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '528cd7bb98a34db1bb5b8afd2c539273'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:00.224511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899226e-e33a-4321-9190-2714b4c8f96f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:00.229139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b7475-8970-44ca-905c-af824779bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:00.229831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b7475-8970-44ca-905c-af824779bb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:00.230110 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b7475-8970-44ca-905c-af824779bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:00.230424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b7475-8970-44ca-905c-af824779bb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:00.231194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b7475-8970-44ca-905c-af824779bb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:00.233163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b7475-8970-44ca-905c-af824779bb03 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:00.236683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1017/2029] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:13:59 2022] DELETE /identity/v3/users/528cd7bb98a34db1bb5b8afd2c539273 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:00.244125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1013/2030] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:00.247997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:00.249421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:00.324845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8153282-1782-47f3-81d8-661e95650863 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:00.329709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de72e26-deb1-4686-ba40-0a943842f2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:00.330397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de72e26-deb1-4686-ba40-0a943842f2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:00.330663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de72e26-deb1-4686-ba40-0a943842f2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:00.330937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de72e26-deb1-4686-ba40-0a943842f2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:00.331701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de72e26-deb1-4686-ba40-0a943842f2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:00.333296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de72e26-deb1-4686-ba40-0a943842f2e3 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:00.347155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1018/2031] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:00.348670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b7475-8970-44ca-905c-af824779bb03 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:00.358649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b7475-8970-44ca-905c-af824779bb03 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:00.363608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82f0a8-9c4b-4488-88cb-620ed730033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:00.364497 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82f0a8-9c4b-4488-88cb-620ed730033f admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:00.364789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82f0a8-9c4b-4488-88cb-620ed730033f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:00.365071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82f0a8-9c4b-4488-88cb-620ed730033f admin admin] PATH_INFO: `/v3/projects/b95ce96c35214e2195822766d25329cd/users/ce21f2e2d2ae4bfd8fe289d7e36cec01/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:00.380191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82f0a8-9c4b-4488-88cb-620ed730033f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95ce96c35214e2195822766d25329cd, user_id=ce21f2e2d2ae4bfd8fe289d7e36cec01, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:00.382864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82f0a8-9c4b-4488-88cb-620ed730033f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:00.475123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1014/2032] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:00 2022] PUT /identity/v3/projects/b95ce96c35214e2195822766d25329cd/users/ce21f2e2d2ae4bfd8fe289d7e36cec01/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:00.487875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211381-3f78-40ba-9096-6f12defb75eb None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:00.488442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211381-3f78-40ba-9096-6f12defb75eb None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:00.493646 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211381-3f78-40ba-9096-6f12defb75eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:00.522070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f4211381-3f78-40ba-9096-6f12defb75eb None None] MFA Rules not processed for user `ce21f2e2d2ae4bfd8fe289d7e36cec01`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:00.523315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f4211381-3f78-40ba-9096-6f12defb75eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:00.592961 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1019/2033] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:00.597884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82f0a8-9c4b-4488-88cb-620ed730033f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:00.649404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211381-3f78-40ba-9096-6f12defb75eb None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:00.651487 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f4211381-3f78-40ba-9096-6f12defb75eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:00.661982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82f0a8-9c4b-4488-88cb-620ed730033f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:00.665392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211381-3f78-40ba-9096-6f12defb75eb None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:00.667466 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60a027-dbad-4fe1-8118-0ece1b324cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:00.668188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60a027-dbad-4fe1-8118-0ece1b324cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:00.668479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60a027-dbad-4fe1-8118-0ece1b324cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:00.668778 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60a027-dbad-4fe1-8118-0ece1b324cc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:00.669642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60a027-dbad-4fe1-8118-0ece1b324cc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:00.671544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:00.671711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60a027-dbad-4fe1-8118-0ece1b324cc1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:00.672481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:00.672742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:00.673020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] PATH_INFO: `/v3/projects/bfb786db1b9a4c3e819caed3bbc7d203` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:00.674244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb786db1b9a4c3e819caed3bbc7d203)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:00.676205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:00.775356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1015/2034] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:00 2022] POST /identity/v3/projects => generated 403 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:00.780526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60a027-dbad-4fe1-8118-0ece1b324cc1 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:00.797476 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb786db1b9a4c3e819caed3bbc7d203', 'request_id': 'req-b7faa463-bbd9-45b5-9664-ff2256ee98d0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:00.803198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb786db1b9a4c3e819caed3bbc7d203', 'request_id': 'req-b7faa463-bbd9-45b5-9664-ff2256ee98d0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:00.810565 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb786db1b9a4c3e819caed3bbc7d203', 'request_id': 'req-b7faa463-bbd9-45b5-9664-ff2256ee98d0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:00.844800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:00.847974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60a027-dbad-4fe1-8118-0ece1b324cc1 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:00.895825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] The token cache is being invalidate because project bfb786db1b9a4c3e819caed3bbc7d203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:00.896126 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:00.896922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b7faa463-bbd9-45b5-9664-ff2256ee98d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:00.898625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1020/2035] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:00 2022] DELETE /identity/v3/projects/bfb786db1b9a4c3e819caed3bbc7d203 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:00.904187 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab057b-0d0d-4403-9617-3a8392e85a1a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:00.904484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab057b-0d0d-4403-9617-3a8392e85a1a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:00.904769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab057b-0d0d-4403-9617-3a8392e85a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:00.905699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f311d-393f-4093-b98e-975ca438bae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:00.906483 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f311d-393f-4093-b98e-975ca438bae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:00.906712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f311d-393f-4093-b98e-975ca438bae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:00.907020 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f311d-393f-4093-b98e-975ca438bae4 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:00.907734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f311d-393f-4093-b98e-975ca438bae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:00.909670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f311d-393f-4093-b98e-975ca438bae4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:00.926129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6dab057b-0d0d-4403-9617-3a8392e85a1a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:00.927360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6dab057b-0d0d-4403-9617-3a8392e85a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:00.935886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1021/2036] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:00.943734 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1170-1fdf-4e68-9117-564e0ea8ead1 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:00.944030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1170-1fdf-4e68-9117-564e0ea8ead1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:00.944317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1170-1fdf-4e68-9117-564e0ea8ead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:00.963572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0c5c1170-1fdf-4e68-9117-564e0ea8ead1 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:00.964828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0c5c1170-1fdf-4e68-9117-564e0ea8ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:00.973058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1022/2037] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:00.977190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c1170-1fdf-4e68-9117-564e0ea8ead1 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:00.987084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c1170-1fdf-4e68-9117-564e0ea8ead1 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:00.991741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858aabe-d082-4237-8d2c-c1feece1b8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:00.992426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858aabe-d082-4237-8d2c-c1feece1b8de admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:00.992710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858aabe-d082-4237-8d2c-c1feece1b8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:00.993128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858aabe-d082-4237-8d2c-c1feece1b8de admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:00.994057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858aabe-d082-4237-8d2c-c1feece1b8de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:00.995277 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858aabe-d082-4237-8d2c-c1feece1b8de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:00.996752 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858aabe-d082-4237-8d2c-c1feece1b8de admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.012660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1023/2038] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:14:01.016584 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858aabe-d082-4237-8d2c-c1feece1b8de admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.026470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858aabe-d082-4237-8d2c-c1feece1b8de admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.031864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e488378-d11b-49f6-a00a-cb3f6e9aaf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.034146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e488378-d11b-49f6-a00a-cb3f6e9aaf70 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.034146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e488378-d11b-49f6-a00a-cb3f6e9aaf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.034146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e488378-d11b-49f6-a00a-cb3f6e9aaf70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.034414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1016/2039] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:00 2022] POST /identity/v3/users => generated 308 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:01.034500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e488378-d11b-49f6-a00a-cb3f6e9aaf70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.039020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e488378-d11b-49f6-a00a-cb3f6e9aaf70 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.039791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:01.040588 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f311d-393f-4093-b98e-975ca438bae4 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.043514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b95f311d-393f-4093-b98e-975ca438bae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:01.061524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f311d-393f-4093-b98e-975ca438bae4 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.066240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49802794-ce9d-4a05-8250-a76ad9e38f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.066905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49802794-ce9d-4a05-8250-a76ad9e38f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.067189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49802794-ce9d-4a05-8250-a76ad9e38f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.067466 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49802794-ce9d-4a05-8250-a76ad9e38f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.068236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49802794-ce9d-4a05-8250-a76ad9e38f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.069907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49802794-ce9d-4a05-8250-a76ad9e38f4b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.083463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1017/2040] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:01.084484 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49802794-ce9d-4a05-8250-a76ad9e38f4b admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.095064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49802794-ce9d-4a05-8250-a76ad9e38f4b admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.101121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b4672-406e-42d6-bbcb-797f5d4fe343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.102094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b4672-406e-42d6-bbcb-797f5d4fe343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.102539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b4672-406e-42d6-bbcb-797f5d4fe343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.102902 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b4672-406e-42d6-bbcb-797f5d4fe343 admin admin] PATH_INFO: `/v3/projects/c824e757b5b1415fbe778d9a1d5ac2d7/users/b7f3596375594650a8b0fc74eb52a870/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.129165 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b4672-406e-42d6-bbcb-797f5d4fe343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c824e757b5b1415fbe778d9a1d5ac2d7, user_id=b7f3596375594650a8b0fc74eb52a870, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.132021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b4672-406e-42d6-bbcb-797f5d4fe343 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.172946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1024/2041] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:01 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:01.173962 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e488378-d11b-49f6-a00a-cb3f6e9aaf70 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.237063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e488378-d11b-49f6-a00a-cb3f6e9aaf70 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.241933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d13933-2e0c-44e0-8b04-4dcf0304af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.242610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d13933-2e0c-44e0-8b04-4dcf0304af90 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.242960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d13933-2e0c-44e0-8b04-4dcf0304af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.243237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d13933-2e0c-44e0-8b04-4dcf0304af90 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.243957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d13933-2e0c-44e0-8b04-4dcf0304af90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.247072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d13933-2e0c-44e0-8b04-4dcf0304af90 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.258904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1018/2042] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:01 2022] PUT /identity/v3/projects/c824e757b5b1415fbe778d9a1d5ac2d7/users/b7f3596375594650a8b0fc74eb52a870/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:01.262952 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b4672-406e-42d6-bbcb-797f5d4fe343 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.327288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b4672-406e-42d6-bbcb-797f5d4fe343 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.332132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0c88c-95d1-4699-9420-22aaf274b216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.332808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0c88c-95d1-4699-9420-22aaf274b216 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.333098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0c88c-95d1-4699-9420-22aaf274b216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.333384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0c88c-95d1-4699-9420-22aaf274b216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.334118 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0c88c-95d1-4699-9420-22aaf274b216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.335741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0c88c-95d1-4699-9420-22aaf274b216 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.348582 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1019/2044] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:01.348720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1025/2044] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:01 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:01.350089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0c88c-95d1-4699-9420-22aaf274b216 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.356055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d13933-2e0c-44e0-8b04-4dcf0304af90 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.360785 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0c88c-95d1-4699-9420-22aaf274b216 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.366834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d13933-2e0c-44e0-8b04-4dcf0304af90 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.368020 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecce29-224f-46d0-869d-58108a9e6321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.368700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecce29-224f-46d0-869d-58108a9e6321 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.371500 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecce29-224f-46d0-869d-58108a9e6321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.371500 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecce29-224f-46d0-869d-58108a9e6321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.371500 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecce29-224f-46d0-869d-58108a9e6321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.372424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecce29-224f-46d0-869d-58108a9e6321 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.373942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546a328-8b4e-4c02-b193-21e7eb4e77b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.374911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546a328-8b4e-4c02-b193-21e7eb4e77b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.375270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546a328-8b4e-4c02-b193-21e7eb4e77b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.375669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546a328-8b4e-4c02-b193-21e7eb4e77b2 admin admin] PATH_INFO: `/v3/projects/c824e757b5b1415fbe778d9a1d5ac2d7/users/b7f3596375594650a8b0fc74eb52a870/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.380835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546a328-8b4e-4c02-b193-21e7eb4e77b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c824e757b5b1415fbe778d9a1d5ac2d7, user_id=b7f3596375594650a8b0fc74eb52a870, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.387646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1020/2045] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:01.387794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546a328-8b4e-4c02-b193-21e7eb4e77b2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.392195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecce29-224f-46d0-869d-58108a9e6321 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.396287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1026/2046] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:01 2022] PUT /identity/v3/projects/c824e757b5b1415fbe778d9a1d5ac2d7/users/b7f3596375594650a8b0fc74eb52a870/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:01.411672 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecce29-224f-46d0-869d-58108a9e6321 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.412028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca5ce3-d282-4b3c-8c0f-5168cd3e7011 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.412028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca5ce3-d282-4b3c-8c0f-5168cd3e7011 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.412028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca5ce3-d282-4b3c-8c0f-5168cd3e7011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.443743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f1ca5ce3-d282-4b3c-8c0f-5168cd3e7011 None None] MFA Rules not processed for user `b7f3596375594650a8b0fc74eb52a870`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:01.444384 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f1ca5ce3-d282-4b3c-8c0f-5168cd3e7011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:01.472010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bad26-7b53-4e20-827f-e5538cdbe53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.472682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bad26-7b53-4e20-827f-e5538cdbe53c admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.472970 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bad26-7b53-4e20-827f-e5538cdbe53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.473249 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116bad26-7b53-4e20-827f-e5538cdbe53c admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.474002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bad26-7b53-4e20-827f-e5538cdbe53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.475816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116bad26-7b53-4e20-827f-e5538cdbe53c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.488535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1021/2047] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:01.490725 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bad26-7b53-4e20-827f-e5538cdbe53c admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.492614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-116bad26-7b53-4e20-827f-e5538cdbe53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:01.519541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1027/2048] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:01.520447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca5ce3-d282-4b3c-8c0f-5168cd3e7011 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.532670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca5ce3-d282-4b3c-8c0f-5168cd3e7011 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.537363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717f4b1-4fc4-4675-be15-d40fda919eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.538249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717f4b1-4fc4-4675-be15-d40fda919eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.538536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717f4b1-4fc4-4675-be15-d40fda919eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.538818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717f4b1-4fc4-4675-be15-d40fda919eb3 admin admin] PATH_INFO: `/v3/projects/eadd872832804a46929650f73e629f8e/users/72ff310ac32b4b7d97e09b0848bf74ec/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.554101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717f4b1-4fc4-4675-be15-d40fda919eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadd872832804a46929650f73e629f8e, user_id=72ff310ac32b4b7d97e09b0848bf74ec, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.554977 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116bad26-7b53-4e20-827f-e5538cdbe53c admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.558039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717f4b1-4fc4-4675-be15-d40fda919eb3 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.558903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df517ae1-481a-460f-a54c-80e5649b9947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.559598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df517ae1-481a-460f-a54c-80e5649b9947 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.559893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df517ae1-481a-460f-a54c-80e5649b9947 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.564159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df517ae1-481a-460f-a54c-80e5649b9947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.564159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-df517ae1-481a-460f-a54c-80e5649b9947 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:01.624777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df517ae1-481a-460f-a54c-80e5649b9947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.626153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df517ae1-481a-460f-a54c-80e5649b9947 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.636452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1022/2049] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:01.638046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df517ae1-481a-460f-a54c-80e5649b9947 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.639334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-df517ae1-481a-460f-a54c-80e5649b9947 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:01.649974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df517ae1-481a-460f-a54c-80e5649b9947 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.654411 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19e60d-b29f-400c-a13c-148311bf9fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.655059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e60d-b29f-400c-a13c-148311bf9fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.655347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e60d-b29f-400c-a13c-148311bf9fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.655660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e60d-b29f-400c-a13c-148311bf9fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.668405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19e60d-b29f-400c-a13c-148311bf9fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.669953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19e60d-b29f-400c-a13c-148311bf9fa2 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.680362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1023/2050] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:01 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:01.693581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1028/2051] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:01 2022] PUT /identity/v3/projects/eadd872832804a46929650f73e629f8e/users/72ff310ac32b4b7d97e09b0848bf74ec/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:01.705619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472105-002a-4a64-954c-5f3ae3323458 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.706016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472105-002a-4a64-954c-5f3ae3323458 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.706306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472105-002a-4a64-954c-5f3ae3323458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.718329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:01.740961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-46472105-002a-4a64-954c-5f3ae3323458 None None] MFA Rules not processed for user `72ff310ac32b4b7d97e09b0848bf74ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:01.742310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-46472105-002a-4a64-954c-5f3ae3323458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:01.812499 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1024/2052] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:01.817553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717f4b1-4fc4-4675-be15-d40fda919eb3 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.834886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46472105-002a-4a64-954c-5f3ae3323458 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:01.848752 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:01.895017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717f4b1-4fc4-4675-be15-d40fda919eb3 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.900040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cff32-4790-4666-bd59-be8ead5fbbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.900714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cff32-4790-4666-bd59-be8ead5fbbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.901002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cff32-4790-4666-bd59-be8ead5fbbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.901289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cff32-4790-4666-bd59-be8ead5fbbf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.902462 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cff32-4790-4666-bd59-be8ead5fbbf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.904132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cff32-4790-4666-bd59-be8ead5fbbf7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:01.906815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46472105-002a-4a64-954c-5f3ae3323458 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:01.913644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9a0e0-31e8-4621-a4c6-74b555d4d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:01.914726 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a0e0-31e8-4621-a4c6-74b555d4d459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:01.915054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a0e0-31e8-4621-a4c6-74b555d4d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:01.915340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9a0e0-31e8-4621-a4c6-74b555d4d459 admin admin] PATH_INFO: `/v3/users/ce21f2e2d2ae4bfd8fe289d7e36cec01` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:01.917215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9a0e0-31e8-4621-a4c6-74b555d4d459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce21f2e2d2ae4bfd8fe289d7e36cec01)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:01.919220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9a0e0-31e8-4621-a4c6-74b555d4d459 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:02.016437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1029/2053] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:01 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:02.020571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cff32-4790-4666-bd59-be8ead5fbbf7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:02.081981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cff32-4790-4666-bd59-be8ead5fbbf7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:02.084873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f6c9a0e0-31e8-4621-a4c6-74b555d4d459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce21f2e2d2ae4bfd8fe289d7e36cec01'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:02.087724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4735c-0534-4742-9324-c92c1edb70a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:02.089054 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4735c-0534-4742-9324-c92c1edb70a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:02.089340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4735c-0534-4742-9324-c92c1edb70a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:02.089666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4735c-0534-4742-9324-c92c1edb70a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:02.090356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4735c-0534-4742-9324-c92c1edb70a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:02.092442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4735c-0534-4742-9324-c92c1edb70a8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:02.098117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f6c9a0e0-31e8-4621-a4c6-74b555d4d459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce21f2e2d2ae4bfd8fe289d7e36cec01'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:02.099008 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f6c9a0e0-31e8-4621-a4c6-74b555d4d459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce21f2e2d2ae4bfd8fe289d7e36cec01'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:02.106957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f6c9a0e0-31e8-4621-a4c6-74b555d4d459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce21f2e2d2ae4bfd8fe289d7e36cec01'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:02.107665 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f6c9a0e0-31e8-4621-a4c6-74b555d4d459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce21f2e2d2ae4bfd8fe289d7e36cec01'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:02.236467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1025/2054] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:01 2022] DELETE /identity/v3/users/ce21f2e2d2ae4bfd8fe289d7e36cec01 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:02.240259 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1030/2055] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:02 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:02.240936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63351040-bafa-4518-91c5-fc51d79a3895 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:02.241336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63351040-bafa-4518-91c5-fc51d79a3895 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:02.241455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4735c-0534-4742-9324-c92c1edb70a8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:02.241809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63351040-bafa-4518-91c5-fc51d79a3895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:02.243041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a4b4735c-0534-4742-9324-c92c1edb70a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:02.255544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4735c-0534-4742-9324-c92c1edb70a8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:02.260624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-63351040-bafa-4518-91c5-fc51d79a3895 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:02.261835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-63351040-bafa-4518-91c5-fc51d79a3895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:02.322188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8125a5-8725-4c31-8abd-1dae0d8b2386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:02.323073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8125a5-8725-4c31-8abd-1dae0d8b2386 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:02.323369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8125a5-8725-4c31-8abd-1dae0d8b2386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:02.323686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8125a5-8725-4c31-8abd-1dae0d8b2386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:02.324451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8125a5-8725-4c31-8abd-1dae0d8b2386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:02.326087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8125a5-8725-4c31-8abd-1dae0d8b2386 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:02.327733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1026/2056] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:02.337463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63351040-bafa-4518-91c5-fc51d79a3895 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:02.339611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-63351040-bafa-4518-91c5-fc51d79a3895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:02.340697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1031/2057] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:02.342720 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:02.344615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8125a5-8725-4c31-8abd-1dae0d8b2386 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:02.355688 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8125a5-8725-4c31-8abd-1dae0d8b2386 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:02.360598 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3ed30-002e-4984-814c-e0d7cf44aaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:02.361257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3ed30-002e-4984-814c-e0d7cf44aaff admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:02.361538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3ed30-002e-4984-814c-e0d7cf44aaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:02.361818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3ed30-002e-4984-814c-e0d7cf44aaff admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:02.362546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3ed30-002e-4984-814c-e0d7cf44aaff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:02.364174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3ed30-002e-4984-814c-e0d7cf44aaff admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:02.374695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1032/2058] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:02.379017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3ed30-002e-4984-814c-e0d7cf44aaff admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:02.389679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3ed30-002e-4984-814c-e0d7cf44aaff admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:02.394257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb321-f665-4b50-ac8c-185b22bb5aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:02.395113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb321-f665-4b50-ac8c-185b22bb5aed admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:02.395391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb321-f665-4b50-ac8c-185b22bb5aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:02.395693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb321-f665-4b50-ac8c-185b22bb5aed admin admin] PATH_INFO: `/v3/projects/46a6e183614c4a87935c4ff7ad65da60/users/2f4c91577bda4ca0832702c190e30d4b/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:02.401328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:02.405514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63351040-bafa-4518-91c5-fc51d79a3895 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:02.414992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d4b53-fdaa-4180-bfbd-7a0e34344998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:02.414992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d4b53-fdaa-4180-bfbd-7a0e34344998 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:02.414992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d4b53-fdaa-4180-bfbd-7a0e34344998 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:02.414992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d4b53-fdaa-4180-bfbd-7a0e34344998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:02.415349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdb321-f665-4b50-ac8c-185b22bb5aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a6e183614c4a87935c4ff7ad65da60, user_id=2f4c91577bda4ca0832702c190e30d4b, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:02.417161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdb321-f665-4b50-ac8c-185b22bb5aed admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:02.421961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d4b53-fdaa-4180-bfbd-7a0e34344998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:02.423427 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d4b53-fdaa-4180-bfbd-7a0e34344998 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:02.433409 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1027/2059] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:02.513705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1033/2060] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:02 2022] PUT /identity/v3/projects/46a6e183614c4a87935c4ff7ad65da60/users/2f4c91577bda4ca0832702c190e30d4b/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:02.524216 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05aba8-f379-47ce-8ddd-b14e1fed781f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:02.524578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05aba8-f379-47ce-8ddd-b14e1fed781f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:02.524896 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05aba8-f379-47ce-8ddd-b14e1fed781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:02.552488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-6d05aba8-f379-47ce-8ddd-b14e1fed781f None None] MFA Rules not processed for user `2f4c91577bda4ca0832702c190e30d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:02.553744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6d05aba8-f379-47ce-8ddd-b14e1fed781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:02.620742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1028/2061] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:02.625469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb321-f665-4b50-ac8c-185b22bb5aed admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:02.694734 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb321-f665-4b50-ac8c-185b22bb5aed admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:02.700140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1c320-5374-4c22-b63d-63322a92c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:02.700884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1c320-5374-4c22-b63d-63322a92c1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:02.701167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1c320-5374-4c22-b63d-63322a92c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:02.701446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1c320-5374-4c22-b63d-63322a92c1d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:02.702163 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1c320-5374-4c22-b63d-63322a92c1d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:02.704110 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1c320-5374-4c22-b63d-63322a92c1d4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:02.818157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1034/2062] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:02 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:02.822329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05aba8-f379-47ce-8ddd-b14e1fed781f None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:02.834398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05aba8-f379-47ce-8ddd-b14e1fed781f None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:02.841443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1c320-5374-4c22-b63d-63322a92c1d4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:02.843121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0fd1c320-5374-4c22-b63d-63322a92c1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:02.915015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1c320-5374-4c22-b63d-63322a92c1d4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:02.917746 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b166937-da44-46f8-9f51-047a1caa5b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:02.918434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166937-da44-46f8-9f51-047a1caa5b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:02.918745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166937-da44-46f8-9f51-047a1caa5b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:02.919029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b166937-da44-46f8-9f51-047a1caa5b29 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:02.919778 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b166937-da44-46f8-9f51-047a1caa5b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:02.921092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:02.921723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b166937-da44-46f8-9f51-047a1caa5b29 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:02.922048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:02.922347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:02.922613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] PATH_INFO: `/v3/projects/b95ce96c35214e2195822766d25329cd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:02.924589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95ce96c35214e2195822766d25329cd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:02.926567 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:03.038518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1029/2063] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:02 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:03.043184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b166937-da44-46f8-9f51-047a1caa5b29 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:03.052922 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b166937-da44-46f8-9f51-047a1caa5b29 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:03.057798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:03.060837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bcb54-2e3b-47e1-a60b-e7799eef1f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:03.061608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bcb54-2e3b-47e1-a60b-e7799eef1f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:03.062195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bcb54-2e3b-47e1-a60b-e7799eef1f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:03.062316 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bcb54-2e3b-47e1-a60b-e7799eef1f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:03.063143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bcb54-2e3b-47e1-a60b-e7799eef1f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:03.064933 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bcb54-2e3b-47e1-a60b-e7799eef1f29 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:03.075775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1030/2064] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:03.080435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bcb54-2e3b-47e1-a60b-e7799eef1f29 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:03.082383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95ce96c35214e2195822766d25329cd', 'request_id': 'req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:03.088559 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95ce96c35214e2195822766d25329cd', 'request_id': 'req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:03.092462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bcb54-2e3b-47e1-a60b-e7799eef1f29 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:03.095505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95ce96c35214e2195822766d25329cd', 'request_id': 'req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:03.147302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:03.159280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d57b8-6d6f-4d20-80ca-8ec35e6626b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:03.160209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d57b8-6d6f-4d20-80ca-8ec35e6626b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:03.160494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d57b8-6d6f-4d20-80ca-8ec35e6626b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:03.160772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d57b8-6d6f-4d20-80ca-8ec35e6626b2 admin admin] PATH_INFO: `/v3/projects/a78ce4d90886403985b60de18bd5049b/users/31ff97b918a249eba7ac883e4b56f3b4/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:03.181255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] The token cache is being invalidate because project b95ce96c35214e2195822766d25329cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:03.181551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:03.182355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:03.184086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1035/2065] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:02 2022] DELETE /identity/v3/projects/b95ce96c35214e2195822766d25329cd => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:03.186315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d57b8-6d6f-4d20-80ca-8ec35e6626b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78ce4d90886403985b60de18bd5049b, user_id=31ff97b918a249eba7ac883e4b56f3b4, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:03.188080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:03.189638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:03.189802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d57b8-6d6f-4d20-80ca-8ec35e6626b2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:03.203386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83628a9a-e80a-4fc5-89fe-392b1d3d8f32 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:03.208135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:03.209069 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:03.209552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:03.209839 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] PATH_INFO: `/v3/users/b7f3596375594650a8b0fc74eb52a870` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:03.212412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f3596375594650a8b0fc74eb52a870)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:03.215216 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:03.288392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1031/2066] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:03 2022] PUT /identity/v3/projects/a78ce4d90886403985b60de18bd5049b/users/31ff97b918a249eba7ac883e4b56f3b4/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:03.292941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d57b8-6d6f-4d20-80ca-8ec35e6626b2 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:03.294669 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-315d57b8-6d6f-4d20-80ca-8ec35e6626b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:03.361111 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d57b8-6d6f-4d20-80ca-8ec35e6626b2 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:03.365943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf285b-b797-45bc-bb42-af4a7b451dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:03.366698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf285b-b797-45bc-bb42-af4a7b451dab admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:03.367041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf285b-b797-45bc-bb42-af4a7b451dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:03.367376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf285b-b797-45bc-bb42-af4a7b451dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:03.368212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf285b-b797-45bc-bb42-af4a7b451dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:03.371304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf285b-b797-45bc-bb42-af4a7b451dab admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:03.379935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1032/2067] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:03.384019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf285b-b797-45bc-bb42-af4a7b451dab admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:03.395615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf285b-b797-45bc-bb42-af4a7b451dab admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:03.400167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8c861-2386-49c5-8d01-7ddbe7bbf88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:03.401563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c861-2386-49c5-8d01-7ddbe7bbf88e admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:03.401842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c861-2386-49c5-8d01-7ddbe7bbf88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:03.402135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8c861-2386-49c5-8d01-7ddbe7bbf88e admin admin] PATH_INFO: `/v3/projects/a78ce4d90886403985b60de18bd5049b/users/31ff97b918a249eba7ac883e4b56f3b4/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:03.404157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8c861-2386-49c5-8d01-7ddbe7bbf88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78ce4d90886403985b60de18bd5049b, user_id=31ff97b918a249eba7ac883e4b56f3b4, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:03.406782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8c861-2386-49c5-8d01-7ddbe7bbf88e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:03.419006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1033/2068] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:03 2022] PUT /identity/v3/projects/a78ce4d90886403985b60de18bd5049b/users/31ff97b918a249eba7ac883e4b56f3b4/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:03.429017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22671dc-f212-43cd-9ded-bae6d3620abd None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:03.429391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22671dc-f212-43cd-9ded-bae6d3620abd None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:03.429780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22671dc-f212-43cd-9ded-bae6d3620abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:03.430030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f3596375594650a8b0fc74eb52a870'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:03.459297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f22671dc-f212-43cd-9ded-bae6d3620abd None None] MFA Rules not processed for user `31ff97b918a249eba7ac883e4b56f3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:03.460567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f22671dc-f212-43cd-9ded-bae6d3620abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:03.530591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f3596375594650a8b0fc74eb52a870'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:03.543853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1034/2069] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:03.554212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f3596375594650a8b0fc74eb52a870'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:03.555261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f3596375594650a8b0fc74eb52a870'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:03.555892 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f3596375594650a8b0fc74eb52a870'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:03.558393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22671dc-f212-43cd-9ded-bae6d3620abd None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:03.559991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f22671dc-f212-43cd-9ded-bae6d3620abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:03.573146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1036/2070] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:03 2022] DELETE /identity/v3/users/b7f3596375594650a8b0fc74eb52a870 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:03.626927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22671dc-f212-43cd-9ded-bae6d3620abd None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:03.680877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9415d-cc28-4cfc-bc77-e650cd1096d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:03.681524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9415d-cc28-4cfc-bc77-e650cd1096d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:03.681849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9415d-cc28-4cfc-bc77-e650cd1096d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:03.682363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9415d-cc28-4cfc-bc77-e650cd1096d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:03.684330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-86f9415d-cc28-4cfc-bc77-e650cd1096d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:03.748053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9415d-cc28-4cfc-bc77-e650cd1096d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:03.749532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9415d-cc28-4cfc-bc77-e650cd1096d1 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:03.763606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1035/2071] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:03.833717 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:03.882785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:03.885764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:03.898367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c672a0-2f10-42a8-a72e-7ed097ae9d85 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:03.903633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa143a-38e6-40e3-8705-79f4c43d3093 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:03.903633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa143a-38e6-40e3-8705-79f4c43d3093 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:03.904045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa143a-38e6-40e3-8705-79f4c43d3093 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:03.906618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa143a-38e6-40e3-8705-79f4c43d3093 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:03.906618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-87fa143a-38e6-40e3-8705-79f4c43d3093 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:03.925836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:03.968520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa143a-38e6-40e3-8705-79f4c43d3093 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:03.970073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa143a-38e6-40e3-8705-79f4c43d3093 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:03.978987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1037/2072] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:04.008012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9415d-cc28-4cfc-bc77-e650cd1096d1 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:04.010388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-86f9415d-cc28-4cfc-bc77-e650cd1096d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:04.093458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9415d-cc28-4cfc-bc77-e650cd1096d1 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:04.098385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:04.099325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.099648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.099933 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] PATH_INFO: `/v3/projects/c824e757b5b1415fbe778d9a1d5ac2d7` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.101138 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c824e757b5b1415fbe778d9a1d5ac2d7)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:04.103119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:04.233925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c824e757b5b1415fbe778d9a1d5ac2d7', 'request_id': 'req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:04.327343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c824e757b5b1415fbe778d9a1d5ac2d7', 'request_id': 'req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:04.335354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c824e757b5b1415fbe778d9a1d5ac2d7', 'request_id': 'req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:04.348400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] The token cache is being invalidate because project c824e757b5b1415fbe778d9a1d5ac2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:04.348684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:04.349407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-913a91a1-0fb6-4f15-bdb4-deda702cb2c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:04.351053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1036/2073] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:04 2022] DELETE /identity/v3/projects/c824e757b5b1415fbe778d9a1d5ac2d7 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:04.356243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:04.356778 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64578d-674b-455d-9e8a-42e51af35421 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.357072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64578d-674b-455d-9e8a-42e51af35421 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.357346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64578d-674b-455d-9e8a-42e51af35421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.375343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bf64578d-674b-455d-9e8a-42e51af35421 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:04.376565 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bf64578d-674b-455d-9e8a-42e51af35421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:04.422660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:04.439439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1038/2074] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:04.447953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75606b-2c37-451b-869e-0a51a9d31857 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.448250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75606b-2c37-451b-869e-0a51a9d31857 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.448529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75606b-2c37-451b-869e-0a51a9d31857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.467200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-1a75606b-2c37-451b-869e-0a51a9d31857 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:04.468509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1a75606b-2c37-451b-869e-0a51a9d31857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:04.476614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1037/2075] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:04.482435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64578d-674b-455d-9e8a-42e51af35421 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:04.492363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64578d-674b-455d-9e8a-42e51af35421 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:04.497762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a877c21-80ef-4f7e-8022-8f63e57e17ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:04.499195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a877c21-80ef-4f7e-8022-8f63e57e17ac admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.499195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a877c21-80ef-4f7e-8022-8f63e57e17ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.499195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a877c21-80ef-4f7e-8022-8f63e57e17ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.499741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a877c21-80ef-4f7e-8022-8f63e57e17ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:04.500205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a877c21-80ef-4f7e-8022-8f63e57e17ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:04.501921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a877c21-80ef-4f7e-8022-8f63e57e17ac admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:04.516455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1039/2076] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:04.520579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75606b-2c37-451b-869e-0a51a9d31857 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:04.530910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75606b-2c37-451b-869e-0a51a9d31857 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:04.535672 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04901e89-4851-473e-b0ac-b4b33469ea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:04.536345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04901e89-4851-473e-b0ac-b4b33469ea89 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.536628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04901e89-4851-473e-b0ac-b4b33469ea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.536905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04901e89-4851-473e-b0ac-b4b33469ea89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.537639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04901e89-4851-473e-b0ac-b4b33469ea89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:04.539551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04901e89-4851-473e-b0ac-b4b33469ea89 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:04.636114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1038/2077] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:04 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:04.636958 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a877c21-80ef-4f7e-8022-8f63e57e17ac admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:04.653982 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a877c21-80ef-4f7e-8022-8f63e57e17ac admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:04.715651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04df79-912a-49ca-bcda-fb380f93cd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:04.716324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04df79-912a-49ca-bcda-fb380f93cd2b admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.716612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04df79-912a-49ca-bcda-fb380f93cd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.716893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04df79-912a-49ca-bcda-fb380f93cd2b admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.717611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04df79-912a-49ca-bcda-fb380f93cd2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:04.719664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04df79-912a-49ca-bcda-fb380f93cd2b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:04.826850 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:04.840509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04901e89-4851-473e-b0ac-b4b33469ea89 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:04.841525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1040/2078] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:04 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:04.853042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04901e89-4851-473e-b0ac-b4b33469ea89 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:04.862579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd475462-6c94-4882-a064-b913b16af73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:04.862579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd475462-6c94-4882-a064-b913b16af73f admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.862579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd475462-6c94-4882-a064-b913b16af73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.862579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd475462-6c94-4882-a064-b913b16af73f admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.863027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd475462-6c94-4882-a064-b913b16af73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:04.863027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd475462-6c94-4882-a064-b913b16af73f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:04.879400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04df79-912a-49ca-bcda-fb380f93cd2b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:04.880278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1039/2079] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:04.894105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04df79-912a-49ca-bcda-fb380f93cd2b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:04.903850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275a376-ff82-4deb-85f5-2c248d395e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:04.904657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275a376-ff82-4deb-85f5-2c248d395e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.905320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275a376-ff82-4deb-85f5-2c248d395e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.905605 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275a376-ff82-4deb-85f5-2c248d395e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.906379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275a376-ff82-4deb-85f5-2c248d395e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:04.908020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275a376-ff82-4deb-85f5-2c248d395e6a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:04.920291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1041/2080] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:04.924642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd475462-6c94-4882-a064-b913b16af73f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:04.936031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd475462-6c94-4882-a064-b913b16af73f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:04.940728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc3ac5-b314-4403-88a4-d01e08dba18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:04.941628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc3ac5-b314-4403-88a4-d01e08dba18c admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:04.941913 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc3ac5-b314-4403-88a4-d01e08dba18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:04.942195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc3ac5-b314-4403-88a4-d01e08dba18c admin admin] PATH_INFO: `/v3/projects/8eca774000214b6298b6234df9c2bad2/users/8d400edf6aab48b4ac2b80399bed523e/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:04.959732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc3ac5-b314-4403-88a4-d01e08dba18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eca774000214b6298b6234df9c2bad2, user_id=8d400edf6aab48b4ac2b80399bed523e, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:04.966241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc3ac5-b314-4403-88a4-d01e08dba18c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:05.028315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1040/2081] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:04 2022] PUT /identity/v3/projects/8eca774000214b6298b6234df9c2bad2/users/8d400edf6aab48b4ac2b80399bed523e/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:05.039439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a519e7-23f4-414f-a421-9e79002e4552 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:05.039775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a519e7-23f4-414f-a421-9e79002e4552 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:05.040086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a519e7-23f4-414f-a421-9e79002e4552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:05.075767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-46a519e7-23f4-414f-a421-9e79002e4552 None None] MFA Rules not processed for user `8d400edf6aab48b4ac2b80399bed523e`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:05.077009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-46a519e7-23f4-414f-a421-9e79002e4552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:05.083793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:05.144649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1042/2082] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:05.149444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc3ac5-b314-4403-88a4-d01e08dba18c admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:05.222552 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc3ac5-b314-4403-88a4-d01e08dba18c admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:05.227295 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67104c95-1422-4d47-8346-809234675d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:05.227988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67104c95-1422-4d47-8346-809234675d5f admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:05.228968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67104c95-1422-4d47-8346-809234675d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:05.229487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67104c95-1422-4d47-8346-809234675d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:05.230271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67104c95-1422-4d47-8346-809234675d5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:05.232233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67104c95-1422-4d47-8346-809234675d5f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:05.278944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:05.323312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1041/2083] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:05 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:05.326899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a519e7-23f4-414f-a421-9e79002e4552 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:05.337648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a519e7-23f4-414f-a421-9e79002e4552 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:05.403553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e9cd1-2fad-40e5-90e2-a193389e7370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:05.404252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e9cd1-2fad-40e5-90e2-a193389e7370 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:05.404543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e9cd1-2fad-40e5-90e2-a193389e7370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:05.404823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e9cd1-2fad-40e5-90e2-a193389e7370 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:05.405533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e9cd1-2fad-40e5-90e2-a193389e7370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:05.407492 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e9cd1-2fad-40e5-90e2-a193389e7370 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:05.527828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1043/2084] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:05 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:05.531741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67104c95-1422-4d47-8346-809234675d5f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:05.542448 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67104c95-1422-4d47-8346-809234675d5f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:05.546955 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7565922-cf42-40a7-ac47-c6f20f2c9972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:05.547644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7565922-cf42-40a7-ac47-c6f20f2c9972 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:05.547937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7565922-cf42-40a7-ac47-c6f20f2c9972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:05.548217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7565922-cf42-40a7-ac47-c6f20f2c9972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:05.549033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7565922-cf42-40a7-ac47-c6f20f2c9972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:05.550663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7565922-cf42-40a7-ac47-c6f20f2c9972 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:05.562347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1042/2085] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:05.566549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e9cd1-2fad-40e5-90e2-a193389e7370 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:05.576713 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e9cd1-2fad-40e5-90e2-a193389e7370 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:05.581596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce5e8-643b-49d2-9bf7-6141d782295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:05.582571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce5e8-643b-49d2-9bf7-6141d782295c admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:05.582890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce5e8-643b-49d2-9bf7-6141d782295c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:05.583176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce5e8-643b-49d2-9bf7-6141d782295c admin admin] PATH_INFO: `/v3/projects/8bece82ac5ee449caf9523e47a232743/users/dce454e4432d417a8c80fe851bfdd092/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:05.599039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ce5e8-643b-49d2-9bf7-6141d782295c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bece82ac5ee449caf9523e47a232743, user_id=dce454e4432d417a8c80fe851bfdd092, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:05.601850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ce5e8-643b-49d2-9bf7-6141d782295c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:05.698386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1044/2086] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:05 2022] PUT /identity/v3/projects/8bece82ac5ee449caf9523e47a232743/users/dce454e4432d417a8c80fe851bfdd092/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:05.702312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7565922-cf42-40a7-ac47-c6f20f2c9972 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:05.712265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7565922-cf42-40a7-ac47-c6f20f2c9972 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:05.771091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372248a5-930a-4cf4-9061-a8dd51604a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:05.771798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372248a5-930a-4cf4-9061-a8dd51604a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:05.772086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372248a5-930a-4cf4-9061-a8dd51604a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:05.772364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372248a5-930a-4cf4-9061-a8dd51604a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:05.773101 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372248a5-930a-4cf4-9061-a8dd51604a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:05.774860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372248a5-930a-4cf4-9061-a8dd51604a8a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:05.776149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:05.788067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1043/2087] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:05.789123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce5e8-643b-49d2-9bf7-6141d782295c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:05.799991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce5e8-643b-49d2-9bf7-6141d782295c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:05.805344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af9860-6282-4e97-8076-9cfdf4bfc91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:05.806482 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af9860-6282-4e97-8076-9cfdf4bfc91a admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:05.807708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af9860-6282-4e97-8076-9cfdf4bfc91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:05.808006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af9860-6282-4e97-8076-9cfdf4bfc91a admin admin] PATH_INFO: `/v3/projects/8bece82ac5ee449caf9523e47a232743/users/dce454e4432d417a8c80fe851bfdd092/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:05.812712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af9860-6282-4e97-8076-9cfdf4bfc91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bece82ac5ee449caf9523e47a232743, user_id=dce454e4432d417a8c80fe851bfdd092, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:05.815391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af9860-6282-4e97-8076-9cfdf4bfc91a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:05.827048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1045/2088] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:05 2022] PUT /identity/v3/projects/8bece82ac5ee449caf9523e47a232743/users/dce454e4432d417a8c80fe851bfdd092/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:05.837513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365765d2-fc93-4b06-9604-80ebf6e0d557 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:05.837906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365765d2-fc93-4b06-9604-80ebf6e0d557 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:05.838201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365765d2-fc93-4b06-9604-80ebf6e0d557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:05.866950 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-365765d2-fc93-4b06-9604-80ebf6e0d557 None None] MFA Rules not processed for user `dce454e4432d417a8c80fe851bfdd092`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:05.868192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-365765d2-fc93-4b06-9604-80ebf6e0d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:05.876939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:05.936241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:05.953549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1044/2089] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:05.965150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af9860-6282-4e97-8076-9cfdf4bfc91a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:05.966842 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-61af9860-6282-4e97-8076-9cfdf4bfc91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:06.024764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af9860-6282-4e97-8076-9cfdf4bfc91a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:06.028761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e56423-6404-44da-968f-5e5c0407bc14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:06.029411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e56423-6404-44da-968f-5e5c0407bc14 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:06.029695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e56423-6404-44da-968f-5e5c0407bc14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:06.029969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e56423-6404-44da-968f-5e5c0407bc14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:06.041026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e56423-6404-44da-968f-5e5c0407bc14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:06.042207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e56423-6404-44da-968f-5e5c0407bc14 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:06.052770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1046/2090] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:06.194194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:06.267712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:06.438362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:06.481819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365765d2-fc93-4b06-9604-80ebf6e0d557 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:06.483801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-365765d2-fc93-4b06-9604-80ebf6e0d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:06.549501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365765d2-fc93-4b06-9604-80ebf6e0d557 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:06.554267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:06.555019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:06.555309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:06.555600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] PATH_INFO: `/v3/users/6ba968017c6d425083177074c47787e1` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:06.556877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba968017c6d425083177074c47787e1)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:06.559112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:06.777049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:06.793330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba968017c6d425083177074c47787e1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.831384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba968017c6d425083177074c47787e1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.832345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba968017c6d425083177074c47787e1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.843186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba968017c6d425083177074c47787e1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.843186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba968017c6d425083177074c47787e1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:06.859471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:06.968075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1045/2091] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:06 2022] DELETE /identity/v3/users/6ba968017c6d425083177074c47787e1 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:06.973046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab87c1-c223-4eb6-8b6d-a6848566bcb6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:06.973572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab87c1-c223-4eb6-8b6d-a6848566bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:06.973766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab87c1-c223-4eb6-8b6d-a6848566bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:06.993880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a0ab87c1-c223-4eb6-8b6d-a6848566bcb6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:06.995356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a0ab87c1-c223-4eb6-8b6d-a6848566bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:07.084898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1047/2092] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:07.095224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:07.096652 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:07.113445 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:07.153256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab87c1-c223-4eb6-8b6d-a6848566bcb6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:07.154681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a0ab87c1-c223-4eb6-8b6d-a6848566bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:07.160987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cc0d4-b6ea-4059-ac73-b18ce9524ad3 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:07.164823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b31162-9ad3-422c-aba8-1394a7343dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:07.165476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31162-9ad3-422c-aba8-1394a7343dde service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:07.165757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31162-9ad3-422c-aba8-1394a7343dde service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:07.166055 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31162-9ad3-422c-aba8-1394a7343dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:07.167501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab87c1-c223-4eb6-8b6d-a6848566bcb6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:07.172297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:07.173214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:07.173501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:07.173783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] PATH_INFO: `/v3/users/8d400edf6aab48b4ac2b80399bed523e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:07.175283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d400edf6aab48b4ac2b80399bed523e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:07.175465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b31162-9ad3-422c-aba8-1394a7343dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:07.176936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b31162-9ad3-422c-aba8-1394a7343dde service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:07.177302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:07.186963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1046/2093] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:07.210305 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:07.379901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d400edf6aab48b4ac2b80399bed523e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.464203 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d400edf6aab48b4ac2b80399bed523e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.472872 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:07.486072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d400edf6aab48b4ac2b80399bed523e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.486822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d400edf6aab48b4ac2b80399bed523e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.487451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d400edf6aab48b4ac2b80399bed523e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.504839 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1048/2094] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:07 2022] DELETE /identity/v3/users/8d400edf6aab48b4ac2b80399bed523e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:07.510879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d9fe3-c0bb-4208-b584-08b0783b1090 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:07.511181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d9fe3-c0bb-4208-b584-08b0783b1090 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:07.511463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d9fe3-c0bb-4208-b584-08b0783b1090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:07.529118 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c86d9fe3-c0bb-4208-b584-08b0783b1090 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:07.530331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c86d9fe3-c0bb-4208-b584-08b0783b1090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:07.533856 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:07.592061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1047/2095] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:07.603103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:07.605304 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:07.664151 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5068d-cc2c-495a-91b9-46ac38f1cb3a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:07.668347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2507f4-fd81-433f-8181-32ff0c9c74eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:07.668994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2507f4-fd81-433f-8181-32ff0c9c74eb service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:07.669297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2507f4-fd81-433f-8181-32ff0c9c74eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:07.669552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2507f4-fd81-433f-8181-32ff0c9c74eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:07.683670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d9fe3-c0bb-4208-b584-08b0783b1090 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:07.685120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c86d9fe3-c0bb-4208-b584-08b0783b1090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:07.685869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2507f4-fd81-433f-8181-32ff0c9c74eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:07.687533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2507f4-fd81-433f-8181-32ff0c9c74eb service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:07.700135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1049/2096] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:07.708505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d9fe3-c0bb-4208-b584-08b0783b1090 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:07.715660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:07.716671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:07.716850 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:07.717335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] PATH_INFO: `/v3/projects/c49aabbf1a0645d095a58c2f76f4702f` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:07.719029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49aabbf1a0645d095a58c2f76f4702f)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:07.721059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:07.861907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49aabbf1a0645d095a58c2f76f4702f', 'request_id': 'req-ba31a67a-99cd-47da-b383-93a164d9543b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.873179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:07.967498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49aabbf1a0645d095a58c2f76f4702f', 'request_id': 'req-ba31a67a-99cd-47da-b383-93a164d9543b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.974761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49aabbf1a0645d095a58c2f76f4702f', 'request_id': 'req-ba31a67a-99cd-47da-b383-93a164d9543b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.975643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:07.986891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] The token cache is being invalidate because project c49aabbf1a0645d095a58c2f76f4702f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:07.987188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.988012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:07.989608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1048/2097] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:07 2022] DELETE /identity/v3/projects/c49aabbf1a0645d095a58c2f76f4702f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:07.993788 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2507f4-fd81-433f-8181-32ff0c9c74eb service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:08.003629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2507f4-fd81-433f-8181-32ff0c9c74eb service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:08.065563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:08.066393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:08.066851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:08.067132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] PATH_INFO: `/v3/users/836c76d03b1f4e0a8417ba7e2ffc3f91` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:08.068370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=836c76d03b1f4e0a8417ba7e2ffc3f91)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:08.070315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:08.143451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:08.145416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:08.157473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:08.167394 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31a67a-99cd-47da-b383-93a164d9543b admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:08.173924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:08.173924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:08.174218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:08.175081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] PATH_INFO: `/v3/projects/8eca774000214b6298b6234df9c2bad2` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:08.180966 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eca774000214b6298b6234df9c2bad2)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:08.183548 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:08.257247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '836c76d03b1f4e0a8417ba7e2ffc3f91'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.286741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eca774000214b6298b6234df9c2bad2', 'request_id': 'req-7b65b955-a777-483d-b1c8-8e41e39d3429'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.341159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '836c76d03b1f4e0a8417ba7e2ffc3f91'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.354277 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '836c76d03b1f4e0a8417ba7e2ffc3f91'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.354919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '836c76d03b1f4e0a8417ba7e2ffc3f91'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.355524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '836c76d03b1f4e0a8417ba7e2ffc3f91'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.368844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1050/2098] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:07 2022] DELETE /identity/v3/users/836c76d03b1f4e0a8417ba7e2ffc3f91 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:08.370520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:08.372522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:08.374039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:08.398194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eca774000214b6298b6234df9c2bad2', 'request_id': 'req-7b65b955-a777-483d-b1c8-8e41e39d3429'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.406902 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eca774000214b6298b6234df9c2bad2', 'request_id': 'req-7b65b955-a777-483d-b1c8-8e41e39d3429'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.421305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] The token cache is being invalidate because project 8eca774000214b6298b6234df9c2bad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:08.421305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.421998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.423763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1049/2099] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:08 2022] DELETE /identity/v3/projects/8eca774000214b6298b6234df9c2bad2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:08.428189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:08.429675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:08.442697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29515009-85e1-42fd-b23c-bfb655e6e760 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:08.448344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c80716-8ae4-40a2-87a3-10afc5978651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:08.449356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c80716-8ae4-40a2-87a3-10afc5978651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:08.449745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c80716-8ae4-40a2-87a3-10afc5978651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:08.450108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c80716-8ae4-40a2-87a3-10afc5978651 admin admin] PATH_INFO: `/v3/users/72ff310ac32b4b7d97e09b0848bf74ec` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:08.451431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c80716-8ae4-40a2-87a3-10afc5978651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ff310ac32b4b7d97e09b0848bf74ec)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:08.453473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c80716-8ae4-40a2-87a3-10afc5978651 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:08.514352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65b955-a777-483d-b1c8-8e41e39d3429 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:08.527104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:08.527104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:08.527104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:08.527453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] PATH_INFO: `/v3/users/dce454e4432d417a8c80fe851bfdd092` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:08.528579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce454e4432d417a8c80fe851bfdd092)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:08.530563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:08.697997 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-90c80716-8ae4-40a2-87a3-10afc5978651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ff310ac32b4b7d97e09b0848bf74ec'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.746545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce454e4432d417a8c80fe851bfdd092'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.760373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce454e4432d417a8c80fe851bfdd092'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.761509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce454e4432d417a8c80fe851bfdd092'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.768595 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce454e4432d417a8c80fe851bfdd092'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.775225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce454e4432d417a8c80fe851bfdd092'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.789879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-90c80716-8ae4-40a2-87a3-10afc5978651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ff310ac32b4b7d97e09b0848bf74ec'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.804607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-90c80716-8ae4-40a2-87a3-10afc5978651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ff310ac32b4b7d97e09b0848bf74ec'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.805322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-90c80716-8ae4-40a2-87a3-10afc5978651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ff310ac32b4b7d97e09b0848bf74ec'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.806028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-90c80716-8ae4-40a2-87a3-10afc5978651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ff310ac32b4b7d97e09b0848bf74ec'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:08.818813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1051/2100] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:08 2022] DELETE /identity/v3/users/72ff310ac32b4b7d97e09b0848bf74ec => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:08.826885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294de97d-38da-4f33-9c61-6c09ace4b267 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:08.828307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294de97d-38da-4f33-9c61-6c09ace4b267 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:08.828307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294de97d-38da-4f33-9c61-6c09ace4b267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:08.847042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-294de97d-38da-4f33-9c61-6c09ace4b267 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:08.848180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-294de97d-38da-4f33-9c61-6c09ace4b267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:08.899619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1050/2101] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:08 2022] DELETE /identity/v3/users/dce454e4432d417a8c80fe851bfdd092 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:08.900646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:08.907947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:08.913506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1052/2102] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:08.925317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294de97d-38da-4f33-9c61-6c09ace4b267 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:08.926837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-294de97d-38da-4f33-9c61-6c09ace4b267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:08.967728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:08.992595 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5f09e-d2a8-4819-afd0-a19394bb6bca admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:08.993249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294de97d-38da-4f33-9c61-6c09ace4b267 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:08.998810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:08.999719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.000047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.000377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] PATH_INFO: `/v3/projects/c8d10d21147c4c1eb1ce4315fca0ee85` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.001941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d10d21147c4c1eb1ce4315fca0ee85)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.003558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.048814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c388f2d-f614-4887-b417-13891bb48c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.049464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388f2d-f614-4887-b417-13891bb48c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.049746 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388f2d-f614-4887-b417-13891bb48c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.050021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c388f2d-f614-4887-b417-13891bb48c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.060138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c388f2d-f614-4887-b417-13891bb48c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.061577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c388f2d-f614-4887-b417-13891bb48c60 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.070941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1053/2103] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:09.142855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:09.164522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d10d21147c4c1eb1ce4315fca0ee85', 'request_id': 'req-ec314f8b-49d1-4c7c-afeb-74d207381741'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.238106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d10d21147c4c1eb1ce4315fca0ee85', 'request_id': 'req-ec314f8b-49d1-4c7c-afeb-74d207381741'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.245692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d10d21147c4c1eb1ce4315fca0ee85', 'request_id': 'req-ec314f8b-49d1-4c7c-afeb-74d207381741'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.256778 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] The token cache is being invalidate because project c8d10d21147c4c1eb1ce4315fca0ee85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:09.257078 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.257825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.260374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1051/2104] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:08 2022] DELETE /identity/v3/projects/c8d10d21147c4c1eb1ce4315fca0ee85 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:09.265134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c388f2d-f614-4887-b417-13891bb48c60 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.266819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1c388f2d-f614-4887-b417-13891bb48c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.281676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c388f2d-f614-4887-b417-13891bb48c60 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.344626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.344993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.345276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.347398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] PATH_INFO: `/v3/users/ac23e931538243868458435b05da9f82` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.347398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac23e931538243868458435b05da9f82)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.349377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.524081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.526316 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.550450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec314f8b-49d1-4c7c-afeb-74d207381741 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.562491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.563851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.564306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.564817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] PATH_INFO: `/v3/projects/8bece82ac5ee449caf9523e47a232743` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.566853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bece82ac5ee449caf9523e47a232743)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.569401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.675349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac23e931538243868458435b05da9f82'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.718240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bece82ac5ee449caf9523e47a232743', 'request_id': 'req-1aa1761c-d1cd-44c5-ae84-f568af199f48'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.824551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac23e931538243868458435b05da9f82'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.837205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac23e931538243868458435b05da9f82'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.838483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac23e931538243868458435b05da9f82'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.839318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac23e931538243868458435b05da9f82'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.852548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1054/2105] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:09 2022] DELETE /identity/v3/users/ac23e931538243868458435b05da9f82 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:09.855125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:09.856226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.892086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bece82ac5ee449caf9523e47a232743', 'request_id': 'req-1aa1761c-d1cd-44c5-ae84-f568af199f48'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.899785 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bece82ac5ee449caf9523e47a232743', 'request_id': 'req-1aa1761c-d1cd-44c5-ae84-f568af199f48'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.913266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] The token cache is being invalidate because project 8bece82ac5ee449caf9523e47a232743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:09.913745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.914470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1aa1761c-d1cd-44c5-ae84-f568af199f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:09.920941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1052/2106] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:09 2022] DELETE /identity/v3/projects/8bece82ac5ee449caf9523e47a232743 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:09.923095 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdd993-84b4-4315-8702-d6e9bb9aef37 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.923680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdd993-84b4-4315-8702-d6e9bb9aef37 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.924063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdd993-84b4-4315-8702-d6e9bb9aef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.938060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b9e4a-e552-4367-b7d9-483a15ebf5ef admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:09.944203 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:09.945273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.945716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.945994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] PATH_INFO: `/v3/projects/eadd872832804a46929650f73e629f8e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.947749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadd872832804a46929650f73e629f8e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:09.949551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-ffbdd993-84b4-4315-8702-d6e9bb9aef37 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:09.951010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ffbdd993-84b4-4315-8702-d6e9bb9aef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.951248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:09.964074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1053/2107] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:09.969066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4839-4898-4521-b289-254c01b31c88 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:09.969432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4839-4898-4521-b289-254c01b31c88 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:09.969795 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4839-4898-4521-b289-254c01b31c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:09.989206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a15c4839-4898-4521-b289-254c01b31c88 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:09.990412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a15c4839-4898-4521-b289-254c01b31c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:09.999433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1054/2108] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:10.003943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c4839-4898-4521-b289-254c01b31c88 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.013667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c4839-4898-4521-b289-254c01b31c88 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.018555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500423ba-b26e-4343-9b57-2c61eeb30b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.019196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500423ba-b26e-4343-9b57-2c61eeb30b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.019479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500423ba-b26e-4343-9b57-2c61eeb30b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.019844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500423ba-b26e-4343-9b57-2c61eeb30b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.020604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500423ba-b26e-4343-9b57-2c61eeb30b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:10.020912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500423ba-b26e-4343-9b57-2c61eeb30b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.022505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500423ba-b26e-4343-9b57-2c61eeb30b30 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.036145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1055/2109] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:14:10.039269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500423ba-b26e-4343-9b57-2c61eeb30b30 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.052836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500423ba-b26e-4343-9b57-2c61eeb30b30 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.057387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834a520-2636-4a4b-932e-2892c69bf29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.058151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834a520-2636-4a4b-932e-2892c69bf29c admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.058415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834a520-2636-4a4b-932e-2892c69bf29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.058689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834a520-2636-4a4b-932e-2892c69bf29c admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.059374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834a520-2636-4a4b-932e-2892c69bf29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.064258 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834a520-2636-4a4b-932e-2892c69bf29c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.081896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadd872832804a46929650f73e629f8e', 'request_id': 'req-4a69efb7-7455-4a44-8074-bb09b46816e0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.091238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadd872832804a46929650f73e629f8e', 'request_id': 'req-4a69efb7-7455-4a44-8074-bb09b46816e0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.099635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadd872832804a46929650f73e629f8e', 'request_id': 'req-4a69efb7-7455-4a44-8074-bb09b46816e0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.140987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1056/2110] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:10.142879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834a520-2636-4a4b-932e-2892c69bf29c admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.211179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] The token cache is being invalidate because project eadd872832804a46929650f73e629f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:10.211179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.211179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.211179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1055/2111] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:09 2022] DELETE /identity/v3/projects/eadd872832804a46929650f73e629f8e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:10.211179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.212509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.213491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834a520-2636-4a4b-932e-2892c69bf29c admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.218588 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101da461-ba69-4eab-9bc2-b8dbb1b1179e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.219294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da461-ba69-4eab-9bc2-b8dbb1b1179e admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.219574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da461-ba69-4eab-9bc2-b8dbb1b1179e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.219885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da461-ba69-4eab-9bc2-b8dbb1b1179e admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.220653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101da461-ba69-4eab-9bc2-b8dbb1b1179e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.223170 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101da461-ba69-4eab-9bc2-b8dbb1b1179e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.280540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69efb7-7455-4a44-8074-bb09b46816e0 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.285927 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.287431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.287431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.287431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] PATH_INFO: `/v3/users/2f4c91577bda4ca0832702c190e30d4b` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.288645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4c91577bda4ca0832702c190e30d4b)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.290728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.323945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1057/2112] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:10.325133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101da461-ba69-4eab-9bc2-b8dbb1b1179e admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.327784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-101da461-ba69-4eab-9bc2-b8dbb1b1179e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.341859 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101da461-ba69-4eab-9bc2-b8dbb1b1179e admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.347885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.348868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.349268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.349649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] PATH_INFO: `/v3/projects/71a4657d359f419fab7f0c6ef2fd3ed5` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.350963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a4657d359f419fab7f0c6ef2fd3ed5)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.353004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.512182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4c91577bda4ca0832702c190e30d4b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.512608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a4657d359f419fab7f0c6ef2fd3ed5', 'request_id': 'req-9b41019a-d6aa-4773-82e9-5c167b6834b2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.598523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4c91577bda4ca0832702c190e30d4b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.621947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4c91577bda4ca0832702c190e30d4b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.622705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4c91577bda4ca0832702c190e30d4b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.623351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4c91577bda4ca0832702c190e30d4b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.642493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1056/2113] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:10 2022] DELETE /identity/v3/users/2f4c91577bda4ca0832702c190e30d4b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:10.643391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.644772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.689797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a4657d359f419fab7f0c6ef2fd3ed5', 'request_id': 'req-9b41019a-d6aa-4773-82e9-5c167b6834b2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.699748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a4657d359f419fab7f0c6ef2fd3ed5', 'request_id': 'req-9b41019a-d6aa-4773-82e9-5c167b6834b2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.710915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] The token cache is being invalidate because project 71a4657d359f419fab7f0c6ef2fd3ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:10.711264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.711911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9b41019a-d6aa-4773-82e9-5c167b6834b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:10.714241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1058/2114] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:10 2022] DELETE /identity/v3/projects/71a4657d359f419fab7f0c6ef2fd3ed5 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:10.718927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3147a-7ddc-478c-ab6e-a853683ff58d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.725414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3147a-7ddc-478c-ab6e-a853683ff58d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.725536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d606bf7-7e1a-495a-9458-2ac501d4f41b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.725635 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3147a-7ddc-478c-ab6e-a853683ff58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.725730 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cefeb-04e1-460d-82d0-c72e396cfdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.725949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cefeb-04e1-460d-82d0-c72e396cfdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.726228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cefeb-04e1-460d-82d0-c72e396cfdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.726517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cefeb-04e1-460d-82d0-c72e396cfdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.727296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cefeb-04e1-460d-82d0-c72e396cfdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.729666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cefeb-04e1-460d-82d0-c72e396cfdb6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.739904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-42e3147a-7ddc-478c-ab6e-a853683ff58d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:10.740816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1057/2115] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:10.741340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-42e3147a-7ddc-478c-ab6e-a853683ff58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.744764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cefeb-04e1-460d-82d0-c72e396cfdb6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.746587 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cf3cefeb-04e1-460d-82d0-c72e396cfdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.750983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1059/2116] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:10.758580 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe332a-e2fe-4317-a3f9-fc3c42885d73 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.758875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe332a-e2fe-4317-a3f9-fc3c42885d73 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.759411 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe332a-e2fe-4317-a3f9-fc3c42885d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.760571 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cefeb-04e1-460d-82d0-c72e396cfdb6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.765487 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212543e-939c-4f2a-b4e4-bee66609dbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.766094 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212543e-939c-4f2a-b4e4-bee66609dbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.766379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212543e-939c-4f2a-b4e4-bee66609dbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.766835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212543e-939c-4f2a-b4e4-bee66609dbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.767682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212543e-939c-4f2a-b4e4-bee66609dbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.769504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212543e-939c-4f2a-b4e4-bee66609dbc9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.780021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c3fe332a-e2fe-4317-a3f9-fc3c42885d73 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:10.780705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1058/2117] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:10.781316 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c3fe332a-e2fe-4317-a3f9-fc3c42885d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.784843 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212543e-939c-4f2a-b4e4-bee66609dbc9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.789385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1060/2118] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:10.793634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe332a-e2fe-4317-a3f9-fc3c42885d73 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.794955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212543e-939c-4f2a-b4e4-bee66609dbc9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.799978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c76b03-2c0c-4050-8f1b-c5bf3a25606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.800955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c76b03-2c0c-4050-8f1b-c5bf3a25606b admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.801243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c76b03-2c0c-4050-8f1b-c5bf3a25606b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.801583 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c76b03-2c0c-4050-8f1b-c5bf3a25606b admin admin] PATH_INFO: `/v3/projects/e083cd69789046368e3a6971a843c22f/users/b3de1403d4ec4cb697562e39a0b7799a/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.802870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe332a-e2fe-4317-a3f9-fc3c42885d73 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.807966 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252ffc1-eb4a-4ee3-ad9b-b5370b36c64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.808600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252ffc1-eb4a-4ee3-ad9b-b5370b36c64c admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.808891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252ffc1-eb4a-4ee3-ad9b-b5370b36c64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.809301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252ffc1-eb4a-4ee3-ad9b-b5370b36c64c admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.812069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252ffc1-eb4a-4ee3-ad9b-b5370b36c64c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:10.812389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252ffc1-eb4a-4ee3-ad9b-b5370b36c64c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.814038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252ffc1-eb4a-4ee3-ad9b-b5370b36c64c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.818662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c76b03-2c0c-4050-8f1b-c5bf3a25606b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e083cd69789046368e3a6971a843c22f, user_id=b3de1403d4ec4cb697562e39a0b7799a, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.821467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c76b03-2c0c-4050-8f1b-c5bf3a25606b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.828113 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1061/2119] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:10.832496 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252ffc1-eb4a-4ee3-ad9b-b5370b36c64c admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:10.845006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252ffc1-eb4a-4ee3-ad9b-b5370b36c64c admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:10.850366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e6390-7dea-471d-8884-c4e6e89c3a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:10.851028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e6390-7dea-471d-8884-c4e6e89c3a68 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.851318 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e6390-7dea-471d-8884-c4e6e89c3a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.851627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e6390-7dea-471d-8884-c4e6e89c3a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.852432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e6390-7dea-471d-8884-c4e6e89c3a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:10.855181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e6390-7dea-471d-8884-c4e6e89c3a68 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:10.891403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1059/2120] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:10 2022] PUT /identity/v3/projects/e083cd69789046368e3a6971a843c22f/users/b3de1403d4ec4cb697562e39a0b7799a/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:10.903800 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889f8d9-5188-4f61-b5f8-46715b74741d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:10.904091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889f8d9-5188-4f61-b5f8-46715b74741d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:10.904374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889f8d9-5188-4f61-b5f8-46715b74741d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:10.931112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2889f8d9-5188-4f61-b5f8-46715b74741d None None] MFA Rules not processed for user `b3de1403d4ec4cb697562e39a0b7799a`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:10.932528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2889f8d9-5188-4f61-b5f8-46715b74741d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:10.970716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1062/2121] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:14:10.974891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e6390-7dea-471d-8884-c4e6e89c3a68 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.005977 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1060/2122] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:11.018083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889f8d9-5188-4f61-b5f8-46715b74741d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.019436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2889f8d9-5188-4f61-b5f8-46715b74741d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.048483 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e6390-7dea-471d-8884-c4e6e89c3a68 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.053360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc81cee-9a9f-4737-a7af-95aa7722930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.054033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc81cee-9a9f-4737-a7af-95aa7722930f admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.054325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc81cee-9a9f-4737-a7af-95aa7722930f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.054608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc81cee-9a9f-4737-a7af-95aa7722930f admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.055424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc81cee-9a9f-4737-a7af-95aa7722930f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.059550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc81cee-9a9f-4737-a7af-95aa7722930f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.079467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2889f8d9-5188-4f61-b5f8-46715b74741d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.090867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:11.131445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c9998-36b2-4a50-8906-7356c12b4b35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d089c711a94b70a198e35443ee7ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.132171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c9998-36b2-4a50-8906-7356c12b4b35 service glance] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.132460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c9998-36b2-4a50-8906-7356c12b4b35 service glance] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.132743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c9998-36b2-4a50-8906-7356c12b4b35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.162099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1063/2123] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:10 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:11.162930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc81cee-9a9f-4737-a7af-95aa7722930f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.164617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5cc81cee-9a9f-4737-a7af-95aa7722930f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.178817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc81cee-9a9f-4737-a7af-95aa7722930f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.185082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.185999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.186287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.186566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] PATH_INFO: `/v3/projects/46a6e183614c4a87935c4ff7ad65da60` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.187803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a6e183614c4a87935c4ff7ad65da60)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.189782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.193490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c9998-36b2-4a50-8906-7356c12b4b35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.194949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c9998-36b2-4a50-8906-7356c12b4b35 service glance] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.205736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1061/2124] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:11.207013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c9998-36b2-4a50-8906-7356c12b4b35 service glance] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.217968 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c9998-36b2-4a50-8906-7356c12b4b35 service glance] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.222822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ac88-f6f6-444f-bf22-7c8a65ca3f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.223671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ac88-f6f6-444f-bf22-7c8a65ca3f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.224282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ac88-f6f6-444f-bf22-7c8a65ca3f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.224769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1ac88-f6f6-444f-bf22-7c8a65ca3f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.226604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:11.237489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ac88-f6f6-444f-bf22-7c8a65ca3f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.237489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1ac88-f6f6-444f-bf22-7c8a65ca3f22 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.242046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1062/2125] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:11.246407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ac88-f6f6-444f-bf22-7c8a65ca3f22 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.257518 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1ac88-f6f6-444f-bf22-7c8a65ca3f22 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.263104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7f4f-993c-4a55-897d-858fc2133804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.263801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7f4f-993c-4a55-897d-858fc2133804 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.264090 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7f4f-993c-4a55-897d-858fc2133804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.264369 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a7f4f-993c-4a55-897d-858fc2133804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.265114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a7f4f-993c-4a55-897d-858fc2133804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.271238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a7f4f-993c-4a55-897d-858fc2133804 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.277732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1063/2126] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:11.281804 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7f4f-993c-4a55-897d-858fc2133804 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.298344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a7f4f-993c-4a55-897d-858fc2133804 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.311341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a6e183614c4a87935c4ff7ad65da60', 'request_id': 'req-69816eee-3003-4857-8e35-a5c91def0ad1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.364732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b65a-2eb3-4117-a4f9-d1469e3a9e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.365629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b65a-2eb3-4117-a4f9-d1469e3a9e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.365911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b65a-2eb3-4117-a4f9-d1469e3a9e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.366180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b65a-2eb3-4117-a4f9-d1469e3a9e62 admin admin] PATH_INFO: `/v3/projects/b3f178e43e9946cb9b82914a12dcff34/users/48fd3bc26b0d4a5e8c0ddb2efe520bbf/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.381147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a6e183614c4a87935c4ff7ad65da60', 'request_id': 'req-69816eee-3003-4857-8e35-a5c91def0ad1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.383709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558b65a-2eb3-4117-a4f9-d1469e3a9e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f178e43e9946cb9b82914a12dcff34, user_id=48fd3bc26b0d4a5e8c0ddb2efe520bbf, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.387368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558b65a-2eb3-4117-a4f9-d1469e3a9e62 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.392942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a6e183614c4a87935c4ff7ad65da60', 'request_id': 'req-69816eee-3003-4857-8e35-a5c91def0ad1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.406379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] The token cache is being invalidate because project 46a6e183614c4a87935c4ff7ad65da60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:11.406674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.407363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.409447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1064/2127] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:11 2022] DELETE /identity/v3/projects/46a6e183614c4a87935c4ff7ad65da60 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:11.413209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.414751 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.427496 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69816eee-3003-4857-8e35-a5c91def0ad1 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.437027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc626b-fde4-4744-a82d-6ece1c59092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.438078 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc626b-fde4-4744-a82d-6ece1c59092b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.438426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc626b-fde4-4744-a82d-6ece1c59092b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.438774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc626b-fde4-4744-a82d-6ece1c59092b admin admin] PATH_INFO: `/v3/users/31ff97b918a249eba7ac883e4b56f3b4` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.440103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc626b-fde4-4744-a82d-6ece1c59092b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ff97b918a249eba7ac883e4b56f3b4)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.442116 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc626b-fde4-4744-a82d-6ece1c59092b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.452916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1064/2128] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:11 2022] PUT /identity/v3/projects/b3f178e43e9946cb9b82914a12dcff34/users/48fd3bc26b0d4a5e8c0ddb2efe520bbf/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:14:11.459603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec9eaf-8012-4091-94b5-84e614f86b10 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.460223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec9eaf-8012-4091-94b5-84e614f86b10 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.460223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec9eaf-8012-4091-94b5-84e614f86b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.488038 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-63ec9eaf-8012-4091-94b5-84e614f86b10 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:11.489290 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-63ec9eaf-8012-4091-94b5-84e614f86b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.553629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1065/2129] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:11.563329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec9eaf-8012-4091-94b5-84e614f86b10 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:11.564818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-63ec9eaf-8012-4091-94b5-84e614f86b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:11.628595 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec9eaf-8012-4091-94b5-84e614f86b10 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:11.631128 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fffc626b-fde4-4744-a82d-6ece1c59092b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ff97b918a249eba7ac883e4b56f3b4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.636173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1b29a-581d-420d-b537-4792c766392f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:11.637269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b29a-581d-420d-b537-4792c766392f service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:11.637819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b29a-581d-420d-b537-4792c766392f service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:11.638294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1b29a-581d-420d-b537-4792c766392f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:11.646964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fffc626b-fde4-4744-a82d-6ece1c59092b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ff97b918a249eba7ac883e4b56f3b4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.647770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fffc626b-fde4-4744-a82d-6ece1c59092b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ff97b918a249eba7ac883e4b56f3b4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.654921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1b29a-581d-420d-b537-4792c766392f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:11.656211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fffc626b-fde4-4744-a82d-6ece1c59092b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ff97b918a249eba7ac883e4b56f3b4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.656914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1b29a-581d-420d-b537-4792c766392f service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:11.657044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fffc626b-fde4-4744-a82d-6ece1c59092b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ff97b918a249eba7ac883e4b56f3b4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:11.668869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1066/2130] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:11.764124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1065/2131] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:11 2022] DELETE /identity/v3/users/31ff97b918a249eba7ac883e4b56f3b4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:12.284907 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1b29a-581d-420d-b537-4792c766392f service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.297317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1b29a-581d-420d-b537-4792c766392f service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.356450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:12.361071 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.361947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.362237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.362521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] PATH_INFO: `/v3/projects/a78ce4d90886403985b60de18bd5049b` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.363746 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78ce4d90886403985b60de18bd5049b)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.365696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.402215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:12.489220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78ce4d90886403985b60de18bd5049b', 'request_id': 'req-762b1b88-5254-4301-b4d8-f1dc746a0965'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:12.496414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78ce4d90886403985b60de18bd5049b', 'request_id': 'req-762b1b88-5254-4301-b4d8-f1dc746a0965'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:12.503531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78ce4d90886403985b60de18bd5049b', 'request_id': 'req-762b1b88-5254-4301-b4d8-f1dc746a0965'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:12.590904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] The token cache is being invalidate because project a78ce4d90886403985b60de18bd5049b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:12.590904 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:12.592130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-762b1b88-5254-4301-b4d8-f1dc746a0965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:12.593681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1067/2132] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:12 2022] DELETE /identity/v3/projects/a78ce4d90886403985b60de18bd5049b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:12.599273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda690d0-ed82-46e1-a6ef-087e3cbd0df8 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.599562 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda690d0-ed82-46e1-a6ef-087e3cbd0df8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.599911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda690d0-ed82-46e1-a6ef-087e3cbd0df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.623212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-dda690d0-ed82-46e1-a6ef-087e3cbd0df8 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:12.624465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-dda690d0-ed82-46e1-a6ef-087e3cbd0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:12.688543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1066/2133] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:12.699017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07af0a-9a4e-493b-b044-b13ad12adf5a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.699381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07af0a-9a4e-493b-b044-b13ad12adf5a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.699886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07af0a-9a4e-493b-b044-b13ad12adf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.752447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3d07af0a-9a4e-493b-b044-b13ad12adf5a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:12.754372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3d07af0a-9a4e-493b-b044-b13ad12adf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:12.767941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1068/2134] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:12.772676 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda690d0-ed82-46e1-a6ef-087e3cbd0df8 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.782900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda690d0-ed82-46e1-a6ef-087e3cbd0df8 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.787645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76348cfc-5481-4cdd-b74d-c6366b1c7070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.788301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348cfc-5481-4cdd-b74d-c6366b1c7070 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.788890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348cfc-5481-4cdd-b74d-c6366b1c7070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.789007 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348cfc-5481-4cdd-b74d-c6366b1c7070 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.789746 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76348cfc-5481-4cdd-b74d-c6366b1c7070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:12.790056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76348cfc-5481-4cdd-b74d-c6366b1c7070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.791709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76348cfc-5481-4cdd-b74d-c6366b1c7070 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.808121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1067/2135] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:12.809257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07af0a-9a4e-493b-b044-b13ad12adf5a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.818944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07af0a-9a4e-493b-b044-b13ad12adf5a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:12.824970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258b168-b4d3-4c42-a4ad-171cca5d77ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:12.825617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258b168-b4d3-4c42-a4ad-171cca5d77ee admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:12.825978 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258b168-b4d3-4c42-a4ad-171cca5d77ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:12.826269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258b168-b4d3-4c42-a4ad-171cca5d77ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:12.826996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258b168-b4d3-4c42-a4ad-171cca5d77ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:12.829097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258b168-b4d3-4c42-a4ad-171cca5d77ee admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:12.956921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76348cfc-5481-4cdd-b74d-c6366b1c7070 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:12.961217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1069/2136] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:12 2022] POST /identity/v3/projects => generated 359 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:12.974531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76348cfc-5481-4cdd-b74d-c6366b1c7070 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.053053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e1571-6636-4a9d-a857-9833f3940afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.053921 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e1571-6636-4a9d-a857-9833f3940afb admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.054273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e1571-6636-4a9d-a857-9833f3940afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.054451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e1571-6636-4a9d-a857-9833f3940afb admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.055147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e1571-6636-4a9d-a857-9833f3940afb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.057753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e1571-6636-4a9d-a857-9833f3940afb admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.163530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1068/2137] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:12 2022] POST /identity/v3/users => generated 280 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:13.168851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258b168-b4d3-4c42-a4ad-171cca5d77ee admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.178872 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258b168-b4d3-4c42-a4ad-171cca5d77ee admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.184184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6f5c-bc99-42d3-a82a-6679889535f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.192792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6f5c-bc99-42d3-a82a-6679889535f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.192792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6f5c-bc99-42d3-a82a-6679889535f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.192792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6f5c-bc99-42d3-a82a-6679889535f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.192792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac6f5c-bc99-42d3-a82a-6679889535f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.192792 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac6f5c-bc99-42d3-a82a-6679889535f7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.198440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1070/2138] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:13.203338 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e1571-6636-4a9d-a857-9833f3940afb admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.216173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e1571-6636-4a9d-a857-9833f3940afb admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.222525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bd29e-89da-442e-a941-11d2cbc19745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.222525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd29e-89da-442e-a941-11d2cbc19745 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.222525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd29e-89da-442e-a941-11d2cbc19745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.222525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bd29e-89da-442e-a941-11d2cbc19745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.222830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bd29e-89da-442e-a941-11d2cbc19745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.223016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bd29e-89da-442e-a941-11d2cbc19745 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.234277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1069/2139] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:13.238433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6f5c-bc99-42d3-a82a-6679889535f7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.249062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6f5c-bc99-42d3-a82a-6679889535f7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.253494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3fb04-710c-4ba4-93f4-6765f855c8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.254364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3fb04-710c-4ba4-93f4-6765f855c8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.254641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3fb04-710c-4ba4-93f4-6765f855c8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.254912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3fb04-710c-4ba4-93f4-6765f855c8dd admin admin] PATH_INFO: `/v3/projects/2ec37dd0aa124b92b37518effdb4db4f/users/1f49e3f838d24c2ba4aeb0c16bf23da3/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.269880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3fb04-710c-4ba4-93f4-6765f855c8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec37dd0aa124b92b37518effdb4db4f, user_id=1f49e3f838d24c2ba4aeb0c16bf23da3, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.273196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3fb04-710c-4ba4-93f4-6765f855c8dd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.372649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a95b-2c66-4e92-a7ec-9fe0a9d3dd43 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.373269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a95b-2c66-4e92-a7ec-9fe0a9d3dd43 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.373516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a95b-2c66-4e92-a7ec-9fe0a9d3dd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.387741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1071/2140] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:13 2022] PUT /identity/v3/projects/2ec37dd0aa124b92b37518effdb4db4f/users/1f49e3f838d24c2ba4aeb0c16bf23da3/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:13.397050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d5ab8-43f2-4728-9eb1-4e552fd63367 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.397342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d5ab8-43f2-4728-9eb1-4e552fd63367 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.397618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d5ab8-43f2-4728-9eb1-4e552fd63367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.406678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e520a95b-2c66-4e92-a7ec-9fe0a9d3dd43 None None] MFA Rules not processed for user `48fd3bc26b0d4a5e8c0ddb2efe520bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:13.408382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e520a95b-2c66-4e92-a7ec-9fe0a9d3dd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:13.434043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-575d5ab8-43f2-4728-9eb1-4e552fd63367 None None] MFA Rules not processed for user `1f49e3f838d24c2ba4aeb0c16bf23da3`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:13.435456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-575d5ab8-43f2-4728-9eb1-4e552fd63367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:13.487768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1070/2141] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:13.501589 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520a95b-2c66-4e92-a7ec-9fe0a9d3dd43 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.503266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e520a95b-2c66-4e92-a7ec-9fe0a9d3dd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:13.511666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1072/2142] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:13 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:13.520482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:13.546443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d5ab8-43f2-4728-9eb1-4e552fd63367 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.547862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-575d5ab8-43f2-4728-9eb1-4e552fd63367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:13.572162 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:13.572743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520a95b-2c66-4e92-a7ec-9fe0a9d3dd43 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.576550 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60ef37-51d6-40ed-b35e-5758e6557eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.577924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60ef37-51d6-40ed-b35e-5758e6557eab service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.579808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60ef37-51d6-40ed-b35e-5758e6557eab service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.581427 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60ef37-51d6-40ed-b35e-5758e6557eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.598507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60ef37-51d6-40ed-b35e-5758e6557eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.600217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60ef37-51d6-40ed-b35e-5758e6557eab service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.611281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1071/2143] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:13.615044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d5ab8-43f2-4728-9eb1-4e552fd63367 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.618932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4e1b0-8f79-4f6b-9af0-8c8b694848a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.619903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4e1b0-8f79-4f6b-9af0-8c8b694848a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.620192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4e1b0-8f79-4f6b-9af0-8c8b694848a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.620474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4e1b0-8f79-4f6b-9af0-8c8b694848a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.629548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4e1b0-8f79-4f6b-9af0-8c8b694848a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.630989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4e1b0-8f79-4f6b-9af0-8c8b694848a6 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.643186 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1073/2144] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:13 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:13.658250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60ef37-51d6-40ed-b35e-5758e6557eab service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:13.742341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60ef37-51d6-40ed-b35e-5758e6557eab service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:13.748036 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:13.748946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:13.749226 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:13.749569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] PATH_INFO: `/v3/users/1f49e3f838d24c2ba4aeb0c16bf23da3` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:13.750688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f49e3f838d24c2ba4aeb0c16bf23da3)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:13.752788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:13.934604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f49e3f838d24c2ba4aeb0c16bf23da3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:13.946324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f49e3f838d24c2ba4aeb0c16bf23da3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:13.947540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f49e3f838d24c2ba4aeb0c16bf23da3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:13.954525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f49e3f838d24c2ba4aeb0c16bf23da3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:13.955176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f49e3f838d24c2ba4aeb0c16bf23da3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:14.036008 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1072/2145] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:13 2022] DELETE /identity/v3/users/1f49e3f838d24c2ba4aeb0c16bf23da3 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:14.040696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea8cad-cef6-413f-bdca-9d278da4b95b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:14.041076 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea8cad-cef6-413f-bdca-9d278da4b95b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:14.041364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea8cad-cef6-413f-bdca-9d278da4b95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:14.060238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a9ea8cad-cef6-413f-bdca-9d278da4b95b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:14.061428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a9ea8cad-cef6-413f-bdca-9d278da4b95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:14.121211 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1074/2146] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:14.131088 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:14.132557 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:14.192743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c32ec4-b495-4226-894e-1e1a92e10da5 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:14.198747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e022c-6713-45f9-8122-31863f9e1320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:14.199419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e022c-6713-45f9-8122-31863f9e1320 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:14.199802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e022c-6713-45f9-8122-31863f9e1320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:14.200091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e022c-6713-45f9-8122-31863f9e1320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:14.213547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e022c-6713-45f9-8122-31863f9e1320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:14.213547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e022c-6713-45f9-8122-31863f9e1320 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:14.227786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1073/2147] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:14.453157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:14.535969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:14.854902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea8cad-cef6-413f-bdca-9d278da4b95b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:14.856453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a9ea8cad-cef6-413f-bdca-9d278da4b95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:14.891497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea8cad-cef6-413f-bdca-9d278da4b95b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:14.891497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:14.891497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:14.891497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:14.893386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] PATH_INFO: `/v3/projects/2ec37dd0aa124b92b37518effdb4db4f` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:14.893386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec37dd0aa124b92b37518effdb4db4f)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:14.893386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:15.255991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec37dd0aa124b92b37518effdb4db4f', 'request_id': 'req-1328a58b-15c4-44c1-8feb-636aa36a9a1b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:15.262428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec37dd0aa124b92b37518effdb4db4f', 'request_id': 'req-1328a58b-15c4-44c1-8feb-636aa36a9a1b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:15.272702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec37dd0aa124b92b37518effdb4db4f', 'request_id': 'req-1328a58b-15c4-44c1-8feb-636aa36a9a1b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:15.327495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b43a44-3586-4e65-92d5-f52e24e7b09d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:15.327860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b43a44-3586-4e65-92d5-f52e24e7b09d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:15.328109 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b43a44-3586-4e65-92d5-f52e24e7b09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:15.346560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-20b43a44-3586-4e65-92d5-f52e24e7b09d None None] MFA Rules not processed for user `48fd3bc26b0d4a5e8c0ddb2efe520bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:15.347789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-20b43a44-3586-4e65-92d5-f52e24e7b09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:15.392209 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] The token cache is being invalidate because project 2ec37dd0aa124b92b37518effdb4db4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:15.392554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:15.393232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:15.394828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1075/2148] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:14 2022] DELETE /identity/v3/projects/2ec37dd0aa124b92b37518effdb4db4f => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:15.403995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1074/2149] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:14:15.593999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:15.672456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:16.110852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:16.234546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=78,keystone:INSERT=5,keystone:DELETE=17 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:16.561509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:16.948077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:17.241376 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:17.364061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:25.807097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:25.808655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:25.921050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a58b-15c4-44c1-8feb-636aa36a9a1b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:25.925711 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:25.926583 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:25.926871 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:25.927151 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] PATH_INFO: `/v3/users/8ffa9d126ec4474093eb1c48afb95bab` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:25.928391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ffa9d126ec4474093eb1c48afb95bab)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:25.930317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:25.943377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:26.091963 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ffa9d126ec4474093eb1c48afb95bab'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.167103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ffa9d126ec4474093eb1c48afb95bab'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.179477 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ffa9d126ec4474093eb1c48afb95bab'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.180182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ffa9d126ec4474093eb1c48afb95bab'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.181144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ffa9d126ec4474093eb1c48afb95bab'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:26.195167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1076/2150] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:25 2022] DELETE /identity/v3/users/8ffa9d126ec4474093eb1c48afb95bab => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:26.200023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1c22-03c2-435f-be5c-13f616f4f7d4 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.200524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1c22-03c2-435f-be5c-13f616f4f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.200608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1c22-03c2-435f-be5c-13f616f4f7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.219292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-ff8d1c22-03c2-435f-be5c-13f616f4f7d4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:26.220803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ff8d1c22-03c2-435f-be5c-13f616f4f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:26.280483 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1075/2151] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:26.290691 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.292268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:26.393573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d13e79-f648-4c96-a7f9-8740aff94f9e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:26.397755 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4c1c-6a7c-46f4-a9f6-eddab6e716df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:26.398411 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4c1c-6a7c-46f4-a9f6-eddab6e716df service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.398701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4c1c-6a7c-46f4-a9f6-eddab6e716df service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.399011 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4c1c-6a7c-46f4-a9f6-eddab6e716df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.410101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4c1c-6a7c-46f4-a9f6-eddab6e716df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:26.411570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4c1c-6a7c-46f4-a9f6-eddab6e716df service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:26.422045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1077/2152] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:26.918972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d1c22-03c2-435f-be5c-13f616f4f7d4 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:26.920444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ff8d1c22-03c2-435f-be5c-13f616f4f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:26.936860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d1c22-03c2-435f-be5c-13f616f4f7d4 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:26.942459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:26.943426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:26.943619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:26.943918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] PATH_INFO: `/v3/projects/8141e4ae9cbd41288674f4b4ab96d586` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:26.945210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8141e4ae9cbd41288674f4b4ab96d586)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:26.948133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.054176 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8141e4ae9cbd41288674f4b4ab96d586', 'request_id': 'req-67ac753a-e035-4010-9c0e-048db5d8dd6a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.137288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8141e4ae9cbd41288674f4b4ab96d586', 'request_id': 'req-67ac753a-e035-4010-9c0e-048db5d8dd6a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.139402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:27.144053 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8141e4ae9cbd41288674f4b4ab96d586', 'request_id': 'req-67ac753a-e035-4010-9c0e-048db5d8dd6a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.154961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] The token cache is being invalidate because project 8141e4ae9cbd41288674f4b4ab96d586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:27.155250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.155949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-67ac753a-e035-4010-9c0e-048db5d8dd6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:27.157496 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1076/2153] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:26 2022] DELETE /identity/v3/projects/8141e4ae9cbd41288674f4b4ab96d586 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:27.162319 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4de1f-60e0-420e-84a7-52c79a30cf03 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.162779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4de1f-60e0-420e-84a7-52c79a30cf03 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.162870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4de1f-60e0-420e-84a7-52c79a30cf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.180070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bfb4de1f-60e0-420e-84a7-52c79a30cf03 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:27.181360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bfb4de1f-60e0-420e-84a7-52c79a30cf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.232422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:27.241463 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1078/2154] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:27.249272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91454-a8a8-448b-8a0f-7ad9b52059d4 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.249743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91454-a8a8-448b-8a0f-7ad9b52059d4 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.249883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e91454-a8a8-448b-8a0f-7ad9b52059d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.270220 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-17e91454-a8a8-448b-8a0f-7ad9b52059d4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:27.271426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-17e91454-a8a8-448b-8a0f-7ad9b52059d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.280325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1077/2155] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:27.284494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4de1f-60e0-420e-84a7-52c79a30cf03 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.294067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4de1f-60e0-420e-84a7-52c79a30cf03 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.298639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e822a9-47bc-492e-9782-30d9c24bf2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.299293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e822a9-47bc-492e-9782-30d9c24bf2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.299612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e822a9-47bc-492e-9782-30d9c24bf2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.299886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e822a9-47bc-492e-9782-30d9c24bf2f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.300615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e822a9-47bc-492e-9782-30d9c24bf2f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:27.300925 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e822a9-47bc-492e-9782-30d9c24bf2f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.302521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e822a9-47bc-492e-9782-30d9c24bf2f8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.314590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1079/2156] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:27.318919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e91454-a8a8-448b-8a0f-7ad9b52059d4 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.328450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e91454-a8a8-448b-8a0f-7ad9b52059d4 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.333056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87b38a-8730-4cca-9e0e-0c9bbe40cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.333694 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87b38a-8730-4cca-9e0e-0c9bbe40cef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.333980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87b38a-8730-4cca-9e0e-0c9bbe40cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.334259 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87b38a-8730-4cca-9e0e-0c9bbe40cef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.334951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87b38a-8730-4cca-9e0e-0c9bbe40cef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.337460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87b38a-8730-4cca-9e0e-0c9bbe40cef9 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.409761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1078/2157] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:27 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:27.413776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e822a9-47bc-492e-9782-30d9c24bf2f8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.423766 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e822a9-47bc-492e-9782-30d9c24bf2f8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.479987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69665e3d-1884-48f7-aa02-33c898a58e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.480662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69665e3d-1884-48f7-aa02-33c898a58e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.480947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69665e3d-1884-48f7-aa02-33c898a58e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.481321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69665e3d-1884-48f7-aa02-33c898a58e97 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.482025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69665e3d-1884-48f7-aa02-33c898a58e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.484009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69665e3d-1884-48f7-aa02-33c898a58e97 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.587060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1080/2158] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:27 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:27.590586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87b38a-8730-4cca-9e0e-0c9bbe40cef9 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.600755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87b38a-8730-4cca-9e0e-0c9bbe40cef9 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.605957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbb73b-81cf-4e1e-a9f3-b4ccd232341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.606693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbb73b-81cf-4e1e-a9f3-b4ccd232341e admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.607047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbb73b-81cf-4e1e-a9f3-b4ccd232341e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.607396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbb73b-81cf-4e1e-a9f3-b4ccd232341e admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.608242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbb73b-81cf-4e1e-a9f3-b4ccd232341e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.609903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbb73b-81cf-4e1e-a9f3-b4ccd232341e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.621171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1079/2159] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:27.625231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69665e3d-1884-48f7-aa02-33c898a58e97 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.636231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69665e3d-1884-48f7-aa02-33c898a58e97 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.641123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d351100-be7a-4128-ba37-7b4187f74731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.641786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d351100-be7a-4128-ba37-7b4187f74731 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.642072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d351100-be7a-4128-ba37-7b4187f74731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.642401 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d351100-be7a-4128-ba37-7b4187f74731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.643136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d351100-be7a-4128-ba37-7b4187f74731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.644771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d351100-be7a-4128-ba37-7b4187f74731 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.655280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1081/2160] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:27.659427 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbb73b-81cf-4e1e-a9f3-b4ccd232341e admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.670050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbb73b-81cf-4e1e-a9f3-b4ccd232341e admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.674643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20b34-48d2-4aed-95a9-4fce29a60360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.675613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20b34-48d2-4aed-95a9-4fce29a60360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.675912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20b34-48d2-4aed-95a9-4fce29a60360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.676188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20b34-48d2-4aed-95a9-4fce29a60360 admin admin] PATH_INFO: `/v3/projects/69e7b26af0f44a81bfe790ca99a13e4e/users/ec08a55f3ec842cea121a5a7142b3d8d/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.692221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f20b34-48d2-4aed-95a9-4fce29a60360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e7b26af0f44a81bfe790ca99a13e4e, user_id=ec08a55f3ec842cea121a5a7142b3d8d, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.694890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f20b34-48d2-4aed-95a9-4fce29a60360 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.790804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1080/2161] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:27 2022] PUT /identity/v3/projects/69e7b26af0f44a81bfe790ca99a13e4e/users/ec08a55f3ec842cea121a5a7142b3d8d/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:27.797067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2609e1-5b52-409d-b133-ef8f2f2909d6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.797368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2609e1-5b52-409d-b133-ef8f2f2909d6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.797653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2609e1-5b52-409d-b133-ef8f2f2909d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.818982 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ef2609e1-5b52-409d-b133-ef8f2f2909d6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:27.820467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ef2609e1-5b52-409d-b133-ef8f2f2909d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.894912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1082/2162] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:27.904909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20b34-48d2-4aed-95a9-4fce29a60360 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:27.906609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-14f20b34-48d2-4aed-95a9-4fce29a60360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:27.962754 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20b34-48d2-4aed-95a9-4fce29a60360 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:27.966306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53bc86-3d72-42b5-b7cb-8e34ac8d9808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:27.966939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53bc86-3d72-42b5-b7cb-8e34ac8d9808 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:27.967221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53bc86-3d72-42b5-b7cb-8e34ac8d9808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:27.967495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53bc86-3d72-42b5-b7cb-8e34ac8d9808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:27.976417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53bc86-3d72-42b5-b7cb-8e34ac8d9808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:27.978516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53bc86-3d72-42b5-b7cb-8e34ac8d9808 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:27.987959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1081/2163] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:29.125754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482eb32-957d-4940-beae-c0b75ac2e85d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.126303 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482eb32-957d-4940-beae-c0b75ac2e85d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.126414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482eb32-957d-4940-beae-c0b75ac2e85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.157494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9482eb32-957d-4940-beae-c0b75ac2e85d None None] MFA Rules not processed for user `ec08a55f3ec842cea121a5a7142b3d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:29.158634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9482eb32-957d-4940-beae-c0b75ac2e85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:29.219086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:29.230271 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1083/2164] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:29.240683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53bc86-3d72-42b5-b7cb-8e34ac8d9808 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:29.242099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4b53bc86-3d72-42b5-b7cb-8e34ac8d9808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:29.301594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53bc86-3d72-42b5-b7cb-8e34ac8d9808 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:29.305094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3f12d-c9a6-4e62-8f3f-3824574cf563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:29.305879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f12d-c9a6-4e62-8f3f-3824574cf563 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:29.306170 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f12d-c9a6-4e62-8f3f-3824574cf563 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:29.306445 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f12d-c9a6-4e62-8f3f-3824574cf563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:29.314517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3f12d-c9a6-4e62-8f3f-3824574cf563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:29.316030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3f12d-c9a6-4e62-8f3f-3824574cf563 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:29.324897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1082/2165] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:31.068087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5d3e-498e-4458-9da9-54d8047afb5d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:31.068812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5d3e-498e-4458-9da9-54d8047afb5d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:31.068812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5d3e-498e-4458-9da9-54d8047afb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:31.092306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-34ab5d3e-498e-4458-9da9-54d8047afb5d None None] MFA Rules not processed for user `ec08a55f3ec842cea121a5a7142b3d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:31.093448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-34ab5d3e-498e-4458-9da9-54d8047afb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:31.100537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1084/2166] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:31.670087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3f12d-c9a6-4e62-8f3f-3824574cf563 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:31.671518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7ac3f12d-c9a6-4e62-8f3f-3824574cf563 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:31.726728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3f12d-c9a6-4e62-8f3f-3824574cf563 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:31.732896 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:31.734006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:31.734610 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:31.735077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] PATH_INFO: `/v3/users/b3de1403d4ec4cb697562e39a0b7799a` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:31.736785 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3de1403d4ec4cb697562e39a0b7799a)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:31.739063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:31.746083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:31.938457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3de1403d4ec4cb697562e39a0b7799a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:31.950875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3de1403d4ec4cb697562e39a0b7799a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:31.951671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3de1403d4ec4cb697562e39a0b7799a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:31.958659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3de1403d4ec4cb697562e39a0b7799a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:31.959335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3de1403d4ec4cb697562e39a0b7799a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:32.024997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1083/2167] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:14:31 2022] DELETE /identity/v3/users/b3de1403d4ec4cb697562e39a0b7799a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:32.029438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2d31-34ee-4256-8247-7dd031f34631 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:32.029758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2d31-34ee-4256-8247-7dd031f34631 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:32.030046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e2d31-34ee-4256-8247-7dd031f34631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:32.057390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2b3e2d31-34ee-4256-8247-7dd031f34631 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:32.058670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2b3e2d31-34ee-4256-8247-7dd031f34631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:32.118153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1085/2168] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:32.127910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:32.129309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:32.189169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e177b2-8299-4749-ac64-9d22aedc1999 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:32.193482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976d63b-57f5-43f0-9039-2e4593406c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:32.194206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976d63b-57f5-43f0-9039-2e4593406c52 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:32.194503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976d63b-57f5-43f0-9039-2e4593406c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:32.194783 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976d63b-57f5-43f0-9039-2e4593406c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:32.207411 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976d63b-57f5-43f0-9039-2e4593406c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:32.208878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976d63b-57f5-43f0-9039-2e4593406c52 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:32.219563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1084/2169] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:14:32.697926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e2d31-34ee-4256-8247-7dd031f34631 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:32.699362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2b3e2d31-34ee-4256-8247-7dd031f34631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:32.712434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e2d31-34ee-4256-8247-7dd031f34631 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:32.718348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:32.719185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:32.719695 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:32.720147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] PATH_INFO: `/v3/projects/e083cd69789046368e3a6971a843c22f` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:32.723049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e083cd69789046368e3a6971a843c22f)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:32.725195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:32.898633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e083cd69789046368e3a6971a843c22f', 'request_id': 'req-bcedf8c6-2418-4eb4-b287-9522e95873bf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:32.905374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e083cd69789046368e3a6971a843c22f', 'request_id': 'req-bcedf8c6-2418-4eb4-b287-9522e95873bf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:32.911712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e083cd69789046368e3a6971a843c22f', 'request_id': 'req-bcedf8c6-2418-4eb4-b287-9522e95873bf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:33.032783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] The token cache is being invalidate because project e083cd69789046368e3a6971a843c22f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:14:33.032984 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:33.033617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bcedf8c6-2418-4eb4-b287-9522e95873bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:14:33.035461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1086/2170] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:14:32 2022] DELETE /identity/v3/projects/e083cd69789046368e3a6971a843c22f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:33.040070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa3016-d6f2-4942-bc14-4988561cc53a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.040584 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa3016-d6f2-4942-bc14-4988561cc53a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.040677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa3016-d6f2-4942-bc14-4988561cc53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.080407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-ccaa3016-d6f2-4942-bc14-4988561cc53a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:33.081764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ccaa3016-d6f2-4942-bc14-4988561cc53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:33.142855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1085/2171] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:33.151081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf54b2-73e5-4bbc-b08f-30d2ee923ce8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.151557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf54b2-73e5-4bbc-b08f-30d2ee923ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.151705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf54b2-73e5-4bbc-b08f-30d2ee923ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.170554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-23bf54b2-73e5-4bbc-b08f-30d2ee923ce8 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:33.171782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-23bf54b2-73e5-4bbc-b08f-30d2ee923ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:33.179850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1087/2172] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:33.184811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa3016-d6f2-4942-bc14-4988561cc53a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:33.194375 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa3016-d6f2-4942-bc14-4988561cc53a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:33.199302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43420b11-f97b-4e6e-8896-a665bc4247d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:33.200000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43420b11-f97b-4e6e-8896-a665bc4247d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.200286 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43420b11-f97b-4e6e-8896-a665bc4247d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.200563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43420b11-f97b-4e6e-8896-a665bc4247d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.201396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43420b11-f97b-4e6e-8896-a665bc4247d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:14:33.201706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43420b11-f97b-4e6e-8896-a665bc4247d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:33.203312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43420b11-f97b-4e6e-8896-a665bc4247d6 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:33.210130 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:33.215313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1086/2173] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:14:33.219831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf54b2-73e5-4bbc-b08f-30d2ee923ce8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:33.230110 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf54b2-73e5-4bbc-b08f-30d2ee923ce8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:33.234819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814636c6-7d9b-4406-bb69-a477573a86e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:33.235491 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814636c6-7d9b-4406-bb69-a477573a86e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.235841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814636c6-7d9b-4406-bb69-a477573a86e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.236124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814636c6-7d9b-4406-bb69-a477573a86e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.236981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814636c6-7d9b-4406-bb69-a477573a86e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:33.240324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814636c6-7d9b-4406-bb69-a477573a86e9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:33.347193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1088/2174] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:14:33 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:33.351156 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43420b11-f97b-4e6e-8896-a665bc4247d6 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:33.362272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43420b11-f97b-4e6e-8896-a665bc4247d6 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:33.420671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f63c8-770f-4693-93c0-74d471ff8dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:33.421467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f63c8-770f-4693-93c0-74d471ff8dea admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.421758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f63c8-770f-4693-93c0-74d471ff8dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.422048 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f63c8-770f-4693-93c0-74d471ff8dea admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.422746 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f63c8-770f-4693-93c0-74d471ff8dea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:33.424727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f63c8-770f-4693-93c0-74d471ff8dea admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:33.520755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1087/2175] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:14:33 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:14:33.525551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814636c6-7d9b-4406-bb69-a477573a86e9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:33.536065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814636c6-7d9b-4406-bb69-a477573a86e9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:33.541483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d44a4f-44f4-4361-83fe-eaa2e06fc998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:33.542138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d44a4f-44f4-4361-83fe-eaa2e06fc998 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.542427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d44a4f-44f4-4361-83fe-eaa2e06fc998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.542821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d44a4f-44f4-4361-83fe-eaa2e06fc998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.543607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d44a4f-44f4-4361-83fe-eaa2e06fc998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:33.545215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d44a4f-44f4-4361-83fe-eaa2e06fc998 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:33.557177 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1089/2176] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:14:33.561028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f63c8-770f-4693-93c0-74d471ff8dea admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:33.571139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f63c8-770f-4693-93c0-74d471ff8dea admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:33.576074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc45627-31ce-4ed3-ad42-f9cb07d2214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:33.576739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45627-31ce-4ed3-ad42-f9cb07d2214d admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.577029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45627-31ce-4ed3-ad42-f9cb07d2214d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.577309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc45627-31ce-4ed3-ad42-f9cb07d2214d admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.578038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc45627-31ce-4ed3-ad42-f9cb07d2214d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:33.579660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc45627-31ce-4ed3-ad42-f9cb07d2214d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:33.590607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1088/2177] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:14:33.594510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d44a4f-44f4-4361-83fe-eaa2e06fc998 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:33.605341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d44a4f-44f4-4361-83fe-eaa2e06fc998 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:33.610647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720e805-2d37-4472-8e85-577af9871210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:33.611565 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720e805-2d37-4472-8e85-577af9871210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.611883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720e805-2d37-4472-8e85-577af9871210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.612165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720e805-2d37-4472-8e85-577af9871210 admin admin] PATH_INFO: `/v3/projects/65d5545a3a584d92b87f8b48b98b43b7/users/be9d302019e24c34a5087b4580d0d25b/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.627953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720e805-2d37-4472-8e85-577af9871210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d5545a3a584d92b87f8b48b98b43b7, user_id=be9d302019e24c34a5087b4580d0d25b, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:33.631238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720e805-2d37-4472-8e85-577af9871210 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:33.733686 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:33.738482 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1090/2178] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:14:33 2022] PUT /identity/v3/projects/65d5545a3a584d92b87f8b48b98b43b7/users/be9d302019e24c34a5087b4580d0d25b/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:14:33.750061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5b4b-6f72-4851-8053-69a7fbce9448 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.750361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5b4b-6f72-4851-8053-69a7fbce9448 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.750651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5b4b-6f72-4851-8053-69a7fbce9448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.778861 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-794b5b4b-6f72-4851-8053-69a7fbce9448 None None] MFA Rules not processed for user `be9d302019e24c34a5087b4580d0d25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:33.780103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-794b5b4b-6f72-4851-8053-69a7fbce9448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:33.849519 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1089/2179] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:33.860420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720e805-2d37-4472-8e85-577af9871210 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:14:33.862201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1720e805-2d37-4472-8e85-577af9871210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:33.942248 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720e805-2d37-4472-8e85-577af9871210 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:14:33.947457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0f394-c8ee-49e5-be20-ae06b0791055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:14:33.948310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0f394-c8ee-49e5-be20-ae06b0791055 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:33.948591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0f394-c8ee-49e5-be20-ae06b0791055 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:33.948892 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0f394-c8ee-49e5-be20-ae06b0791055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:33.959050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0f394-c8ee-49e5-be20-ae06b0791055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:14:33.960697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0f394-c8ee-49e5-be20-ae06b0791055 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:14:33.971191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1091/2180] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:14:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:14:35.127162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a70d4-9cd8-46cf-bebd-e75140cbe716 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:35.127666 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a70d4-9cd8-46cf-bebd-e75140cbe716 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:35.127755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a70d4-9cd8-46cf-bebd-e75140cbe716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:35.146940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-d85a70d4-9cd8-46cf-bebd-e75140cbe716 None None] MFA Rules not processed for user `48fd3bc26b0d4a5e8c0ddb2efe520bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:35.148161 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d85a70d4-9cd8-46cf-bebd-e75140cbe716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:35.207962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1090/2181] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:44.065630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=26 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:45.200598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:14:48.011902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded192-b2b2-4b79-9a76-054004ba0966 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:48.012363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded192-b2b2-4b79-9a76-054004ba0966 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:48.012490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ded192-b2b2-4b79-9a76-054004ba0966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:48.036355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-59ded192-b2b2-4b79-9a76-054004ba0966 None None] MFA Rules not processed for user `c7704f30352a4b7b8b8ee9019d86f50a`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:48.037573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-59ded192-b2b2-4b79-9a76-054004ba0966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:48.099935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1092/2182] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:55.433544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f038247-6373-4b4e-ab7b-8bbd4f4688c0 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:14:55.434084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f038247-6373-4b4e-ab7b-8bbd4f4688c0 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:14:55.434333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f038247-6373-4b4e-ab7b-8bbd4f4688c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:14:55.461738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-6f038247-6373-4b4e-ab7b-8bbd4f4688c0 None None] MFA Rules not processed for user `378532c2b45a4b3b91857c0fc5cb8179`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:14:55.463147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6f038247-6373-4b4e-ab7b-8bbd4f4688c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:14:55.533710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1091/2183] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:14:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:14:58.091902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=25 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:05.527157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=25 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:07.150720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926b55-3503-432f-a4a5-aa15e3fa6632 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:07.151200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926b55-3503-432f-a4a5-aa15e3fa6632 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:07.151287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926b55-3503-432f-a4a5-aa15e3fa6632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:07.188776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2e926b55-3503-432f-a4a5-aa15e3fa6632 None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:07.191615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2e926b55-3503-432f-a4a5-aa15e3fa6632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:07.274813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1093/2184] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:15:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:07.319653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f038247-6373-4b4e-ab7b-8bbd4f4688c0 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:07.321516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6f038247-6373-4b4e-ab7b-8bbd4f4688c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:07.396441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f038247-6373-4b4e-ab7b-8bbd4f4688c0 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:07.403709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde701d0-1c69-4208-b070-04058aef20d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:07.404667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde701d0-1c69-4208-b070-04058aef20d5 service swift] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:07.405166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde701d0-1c69-4208-b070-04058aef20d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:07.405518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde701d0-1c69-4208-b070-04058aef20d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:07.418181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde701d0-1c69-4208-b070-04058aef20d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:07.422598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde701d0-1c69-4208-b070-04058aef20d5 service swift] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:07.430413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1092/2185] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:15:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:15:08.218831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f9aba-e8c7-4413-9ed9-33a3fcda3594 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:08.224050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f9aba-e8c7-4413-9ed9-33a3fcda3594 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:08.224050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f9aba-e8c7-4413-9ed9-33a3fcda3594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:08.239333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-776f9aba-e8c7-4413-9ed9-33a3fcda3594 None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:08.240929 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-776f9aba-e8c7-4413-9ed9-33a3fcda3594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:08.250344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1094/2186] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:15:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:08.266571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde701d0-1c69-4208-b070-04058aef20d5 service swift] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:08.279080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde701d0-1c69-4208-b070-04058aef20d5 service swift] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:08.285318 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206421a2-ee44-4e11-ac8b-f71fc97a556d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:08.285988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206421a2-ee44-4e11-ac8b-f71fc97a556d service swift] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:08.286288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206421a2-ee44-4e11-ac8b-f71fc97a556d service swift] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:08.286583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206421a2-ee44-4e11-ac8b-f71fc97a556d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:08.301075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206421a2-ee44-4e11-ac8b-f71fc97a556d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:08.302703 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206421a2-ee44-4e11-ac8b-f71fc97a556d service swift] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:08.313488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1093/2187] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:15:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:15:18.233612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=35 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:18.310493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=38 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:30.744335 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7aa7ad-3a68-4593-8ca6-0503af5c747c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:30.749214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7aa7ad-3a68-4593-8ca6-0503af5c747c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:30.749214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7aa7ad-3a68-4593-8ca6-0503af5c747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:30.793406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ed7aa7ad-3a68-4593-8ca6-0503af5c747c None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:30.794593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ed7aa7ad-3a68-4593-8ca6-0503af5c747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:30.812616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1095/2188] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 2 10:15:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:30.825036 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206421a2-ee44-4e11-ac8b-f71fc97a556d service swift] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:30.847719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206421a2-ee44-4e11-ac8b-f71fc97a556d service swift] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:30.853094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c9088-ce6c-4bff-9fcc-8bcfa5c50cc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:30.853741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9088-ce6c-4bff-9fcc-8bcfa5c50cc8 service swift] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:30.854022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9088-ce6c-4bff-9fcc-8bcfa5c50cc8 service swift] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:30.854298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c9088-ce6c-4bff-9fcc-8bcfa5c50cc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:30.864427 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c9088-ce6c-4bff-9fcc-8bcfa5c50cc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:30.872288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c9088-ce6c-4bff-9fcc-8bcfa5c50cc8 service swift] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:30.875029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1094/2189] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:15:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:15:31.661208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86913d86-1f44-4f90-b973-7d0f79ba0b21 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:31.661601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86913d86-1f44-4f90-b973-7d0f79ba0b21 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:31.661982 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86913d86-1f44-4f90-b973-7d0f79ba0b21 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:31.663782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1096/2190] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:15:31.675115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588e1a2-8d38-4faa-82d4-5ebfe17d35cb None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:31.675412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588e1a2-8d38-4faa-82d4-5ebfe17d35cb None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:31.678522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588e1a2-8d38-4faa-82d4-5ebfe17d35cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:31.738758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-d588e1a2-8d38-4faa-82d4-5ebfe17d35cb None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:31.740076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d588e1a2-8d38-4faa-82d4-5ebfe17d35cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:31.819567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1095/2191] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:15:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:31.832356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86913d86-1f44-4f90-b973-7d0f79ba0b21 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:31.834096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-86913d86-1f44-4f90-b973-7d0f79ba0b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:31.916556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86913d86-1f44-4f90-b973-7d0f79ba0b21 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:31.921575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60037235-93aa-42ed-a201-141a5101ff20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d089c711a94b70a198e35443ee7ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:31.922316 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037235-93aa-42ed-a201-141a5101ff20 service glance] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:31.922602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037235-93aa-42ed-a201-141a5101ff20 service glance] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:31.922883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60037235-93aa-42ed-a201-141a5101ff20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:31.933696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60037235-93aa-42ed-a201-141a5101ff20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:31.935118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60037235-93aa-42ed-a201-141a5101ff20 service glance] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:31.945902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1097/2192] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:32.242450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98d3e-ddce-4245-b24b-fa635b4d8bd8 None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:32.242927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98d3e-ddce-4245-b24b-fa635b4d8bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:32.243019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98d3e-ddce-4245-b24b-fa635b4d8bd8 None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:32.244429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1096/2193] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:15:32.249877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56559f-40be-4862-919e-8ebc6a7aaeee None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:32.250174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56559f-40be-4862-919e-8ebc6a7aaeee None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:32.250458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56559f-40be-4862-919e-8ebc6a7aaeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:32.274250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-eb56559f-40be-4862-919e-8ebc6a7aaeee None None] MFA Rules not processed for user `d9263fa2ac534b7b9e5c6658c871da9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:32.275803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-eb56559f-40be-4862-919e-8ebc6a7aaeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:32.346453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1098/2194] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:32.358559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a98d3e-ddce-4245-b24b-fa635b4d8bd8 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:32.360272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-01a98d3e-ddce-4245-b24b-fa635b4d8bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:32.373520 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a98d3e-ddce-4245-b24b-fa635b4d8bd8 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:32.377824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092320c-d95f-4924-b310-26ecee1bfa77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:32.378465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092320c-d95f-4924-b310-26ecee1bfa77 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:32.378755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092320c-d95f-4924-b310-26ecee1bfa77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:32.379073 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092320c-d95f-4924-b310-26ecee1bfa77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:32.386601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092320c-d95f-4924-b310-26ecee1bfa77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:32.388089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092320c-d95f-4924-b310-26ecee1bfa77 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:32.396775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1097/2195] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:32.481564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ff5da-68b4-4983-963a-50804d01411d None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:32.481878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ff5da-68b4-4983-963a-50804d01411d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:32.482166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ff5da-68b4-4983-963a-50804d01411d None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:32.483559 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1099/2196] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:15:32.489412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46f15c-f594-47fd-b5f4-bdfbc13f59e6 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:32.489706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46f15c-f594-47fd-b5f4-bdfbc13f59e6 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:32.489987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46f15c-f594-47fd-b5f4-bdfbc13f59e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:32.509030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5e46f15c-f594-47fd-b5f4-bdfbc13f59e6 None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:32.510266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5e46f15c-f594-47fd-b5f4-bdfbc13f59e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:32.521655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1098/2197] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:15:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:32.534205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ff5da-68b4-4983-963a-50804d01411d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:32.548841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ff5da-68b4-4983-963a-50804d01411d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:32.550732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda362b-78ce-4e72-83ba-c1087a712cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:32.551387 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda362b-78ce-4e72-83ba-c1087a712cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:32.551717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda362b-78ce-4e72-83ba-c1087a712cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:32.552001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda362b-78ce-4e72-83ba-c1087a712cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:32.564250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda362b-78ce-4e72-83ba-c1087a712cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:32.571034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda362b-78ce-4e72-83ba-c1087a712cc9 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:32.578423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1100/2198] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:34.068843 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46f15c-f594-47fd-b5f4-bdfbc13f59e6 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:34.126551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda362b-78ce-4e72-83ba-c1087a712cc9 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:34.128078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8eda362b-78ce-4e72-83ba-c1087a712cc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:34.160858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46f15c-f594-47fd-b5f4-bdfbc13f59e6 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:34.166350 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72458399-8df5-402c-a952-dc9746e2cd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:34.167948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458399-8df5-402c-a952-dc9746e2cd73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:34.168243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458399-8df5-402c-a952-dc9746e2cd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:34.168522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72458399-8df5-402c-a952-dc9746e2cd73 admin admin] PATH_INFO: `/v3/users/be9d302019e24c34a5087b4580d0d25b` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:34.171276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72458399-8df5-402c-a952-dc9746e2cd73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9d302019e24c34a5087b4580d0d25b)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:34.173250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72458399-8df5-402c-a952-dc9746e2cd73 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:34.179932 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:34.188218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:34.204837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda362b-78ce-4e72-83ba-c1087a712cc9 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:34.209479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:34.210377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:34.210658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:34.211125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] PATH_INFO: `/v3/users/48fd3bc26b0d4a5e8c0ddb2efe520bbf` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:34.212436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48fd3bc26b0d4a5e8c0ddb2efe520bbf)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:34.214741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:34.381067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-72458399-8df5-402c-a952-dc9746e2cd73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9d302019e24c34a5087b4580d0d25b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:34.396772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-72458399-8df5-402c-a952-dc9746e2cd73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9d302019e24c34a5087b4580d0d25b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:34.397613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-72458399-8df5-402c-a952-dc9746e2cd73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9d302019e24c34a5087b4580d0d25b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:34.407707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-72458399-8df5-402c-a952-dc9746e2cd73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9d302019e24c34a5087b4580d0d25b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:34.408515 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-72458399-8df5-402c-a952-dc9746e2cd73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9d302019e24c34a5087b4580d0d25b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:34.457520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48fd3bc26b0d4a5e8c0ddb2efe520bbf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:34.519243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1099/2199] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:34 2022] DELETE /identity/v3/users/be9d302019e24c34a5087b4580d0d25b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:34.523813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83ab0c-5c55-4458-8a5f-139c2b9cef2f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:34.524554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83ab0c-5c55-4458-8a5f-139c2b9cef2f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:34.524554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83ab0c-5c55-4458-8a5f-139c2b9cef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:34.548134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-3c83ab0c-5c55-4458-8a5f-139c2b9cef2f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:34.549526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-3c83ab0c-5c55-4458-8a5f-139c2b9cef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:34.569484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48fd3bc26b0d4a5e8c0ddb2efe520bbf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:34.594708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48fd3bc26b0d4a5e8c0ddb2efe520bbf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:34.595388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48fd3bc26b0d4a5e8c0ddb2efe520bbf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:34.596036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48fd3bc26b0d4a5e8c0ddb2efe520bbf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:34.617185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1101/2200] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:34 2022] DELETE /identity/v3/users/48fd3bc26b0d4a5e8c0ddb2efe520bbf => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:34.629028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1100/2201] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:15:34.640495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:34.641974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:34.712417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a54bb-c967-4bd2-b631-40f5497eae4a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:34.713157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a54bb-c967-4bd2-b631-40f5497eae4a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:34.713600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a54bb-c967-4bd2-b631-40f5497eae4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:34.724381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fef154-b6a3-4ebb-a70e-da9c4d6ae356 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:34.728453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3d4d1-117e-4ec6-91f0-87bd4cdbf92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:34.728849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3d4d1-117e-4ec6-91f0-87bd4cdbf92f service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:34.729205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3d4d1-117e-4ec6-91f0-87bd4cdbf92f service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:34.729555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3d4d1-117e-4ec6-91f0-87bd4cdbf92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:34.744421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-697a54bb-c967-4bd2-b631-40f5497eae4a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:34.746146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-697a54bb-c967-4bd2-b631-40f5497eae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:34.813461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3d4d1-117e-4ec6-91f0-87bd4cdbf92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:34.815443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3d4d1-117e-4ec6-91f0-87bd4cdbf92f service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:34.832310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1102/2202] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:34.856596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1101/2203] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 10:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:34.881781 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3d4d1-117e-4ec6-91f0-87bd4cdbf92f service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:34.883810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2db3d4d1-117e-4ec6-91f0-87bd4cdbf92f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:34.898635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:34.970851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3d4d1-117e-4ec6-91f0-87bd4cdbf92f service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:34.976797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a05f8-2673-4f13-b926-4edd5d9c1bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:34.977477 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a05f8-2673-4f13-b926-4edd5d9c1bcc service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:34.977770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a05f8-2673-4f13-b926-4edd5d9c1bcc service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:34.978056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a05f8-2673-4f13-b926-4edd5d9c1bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:34.988736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a05f8-2673-4f13-b926-4edd5d9c1bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:34.990427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a05f8-2673-4f13-b926-4edd5d9c1bcc service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:35.016819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1103/2204] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:35.152849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a54bb-c967-4bd2-b631-40f5497eae4a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:35.154968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-697a54bb-c967-4bd2-b631-40f5497eae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:35.213939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a54bb-c967-4bd2-b631-40f5497eae4a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:35.213939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:35.213939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:35.213939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:35.214294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] PATH_INFO: `/v3/projects/b3f178e43e9946cb9b82914a12dcff34` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:35.214294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f178e43e9946cb9b82914a12dcff34)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:35.217006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:35.255114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:35.338130 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f178e43e9946cb9b82914a12dcff34', 'request_id': 'req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.393048 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f178e43e9946cb9b82914a12dcff34', 'request_id': 'req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.402974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f178e43e9946cb9b82914a12dcff34', 'request_id': 'req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.422374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] The token cache is being invalidate because project b3f178e43e9946cb9b82914a12dcff34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:35.422704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.423434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1fbeb1b2-1b85-4d48-982e-71d7a6613f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.425608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1102/2205] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:35 2022] DELETE /identity/v3/projects/b3f178e43e9946cb9b82914a12dcff34 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:35.571642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a05f8-2673-4f13-b926-4edd5d9c1bcc service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:35.573396 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bd0a05f8-2673-4f13-b926-4edd5d9c1bcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:35.589731 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a05f8-2673-4f13-b926-4edd5d9c1bcc service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:35.669702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:35.671211 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:35.671499 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:35.671829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] PATH_INFO: `/v3/projects/65d5545a3a584d92b87f8b48b98b43b7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:35.673135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d5545a3a584d92b87f8b48b98b43b7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:35.675169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:35.822954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d5545a3a584d92b87f8b48b98b43b7', 'request_id': 'req-2ea57c62-07f3-4f46-9b17-c55ea1b322af'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.829860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d5545a3a584d92b87f8b48b98b43b7', 'request_id': 'req-2ea57c62-07f3-4f46-9b17-c55ea1b322af'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.836863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d5545a3a584d92b87f8b48b98b43b7', 'request_id': 'req-2ea57c62-07f3-4f46-9b17-c55ea1b322af'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.922644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] The token cache is being invalidate because project 65d5545a3a584d92b87f8b48b98b43b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:35.922938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.923619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2ea57c62-07f3-4f46-9b17-c55ea1b322af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:35.925426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1104/2206] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:35 2022] DELETE /identity/v3/projects/65d5545a3a584d92b87f8b48b98b43b7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:35.930501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad63b-3ff0-4770-8d8e-1ac6a989617e None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:35.930699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad63b-3ff0-4770-8d8e-1ac6a989617e None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:35.931207 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ad63b-3ff0-4770-8d8e-1ac6a989617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:35.958496 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-582ad63b-3ff0-4770-8d8e-1ac6a989617e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:35.960200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-582ad63b-3ff0-4770-8d8e-1ac6a989617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:36.030887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1103/2207] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:36.038850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a1d5-27c9-41b3-bfc4-6fc6d0b2626b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.039163 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a1d5-27c9-41b3-bfc4-6fc6d0b2626b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.039423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97a1d5-27c9-41b3-bfc4-6fc6d0b2626b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.057480 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ad97a1d5-27c9-41b3-bfc4-6fc6d0b2626b None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:36.058677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ad97a1d5-27c9-41b3-bfc4-6fc6d0b2626b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:36.066585 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1105/2208] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:36.070891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ad63b-3ff0-4770-8d8e-1ac6a989617e None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.081068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ad63b-3ff0-4770-8d8e-1ac6a989617e None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.085677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd0766-c6f4-408c-8fa6-a7a6cea94222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.086324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd0766-c6f4-408c-8fa6-a7a6cea94222 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.086608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd0766-c6f4-408c-8fa6-a7a6cea94222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.086949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd0766-c6f4-408c-8fa6-a7a6cea94222 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.087628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd0766-c6f4-408c-8fa6-a7a6cea94222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:15:36.087936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd0766-c6f4-408c-8fa6-a7a6cea94222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.089526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd0766-c6f4-408c-8fa6-a7a6cea94222 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.105553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1104/2209] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:15:36.106988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97a1d5-27c9-41b3-bfc4-6fc6d0b2626b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.116382 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97a1d5-27c9-41b3-bfc4-6fc6d0b2626b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.121104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e703c-d148-4bad-945a-040e5f46d87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.121745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e703c-d148-4bad-945a-040e5f46d87a admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.122031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e703c-d148-4bad-945a-040e5f46d87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.122306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e703c-d148-4bad-945a-040e5f46d87a admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.122995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e703c-d148-4bad-945a-040e5f46d87a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.126035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e703c-d148-4bad-945a-040e5f46d87a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.141062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:36.271980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1106/2210] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:15:36 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:36.276408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd0766-c6f4-408c-8fa6-a7a6cea94222 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.286587 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd0766-c6f4-408c-8fa6-a7a6cea94222 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.342544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3da116-f087-4285-b7de-271ab6d5d748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.343303 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da116-f087-4285-b7de-271ab6d5d748 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.343604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da116-f087-4285-b7de-271ab6d5d748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.343892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3da116-f087-4285-b7de-271ab6d5d748 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.344580 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3da116-f087-4285-b7de-271ab6d5d748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.346491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3da116-f087-4285-b7de-271ab6d5d748 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.448459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1105/2211] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:15:36 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:15:36.452512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e703c-d148-4bad-945a-040e5f46d87a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.463005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e703c-d148-4bad-945a-040e5f46d87a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.468252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef676-b090-430c-aa28-608ca35c0685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.468956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef676-b090-430c-aa28-608ca35c0685 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.469241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef676-b090-430c-aa28-608ca35c0685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.469518 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef676-b090-430c-aa28-608ca35c0685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.470260 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ef676-b090-430c-aa28-608ca35c0685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.471910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ef676-b090-430c-aa28-608ca35c0685 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.483678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1107/2212] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:15:36.487793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3da116-f087-4285-b7de-271ab6d5d748 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.498090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3da116-f087-4285-b7de-271ab6d5d748 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.503206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa4824-6ebc-4861-94b4-68ee37179752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.503900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4824-6ebc-4861-94b4-68ee37179752 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.504185 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4824-6ebc-4861-94b4-68ee37179752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.504462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4824-6ebc-4861-94b4-68ee37179752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.505529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa4824-6ebc-4861-94b4-68ee37179752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.507005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa4824-6ebc-4861-94b4-68ee37179752 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.518236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1106/2213] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:15:36.522348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef676-b090-430c-aa28-608ca35c0685 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.536285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef676-b090-430c-aa28-608ca35c0685 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.541254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9972b7-a306-4306-86c3-67acf3b7e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.542174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9972b7-a306-4306-86c3-67acf3b7e4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.542465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9972b7-a306-4306-86c3-67acf3b7e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.542801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9972b7-a306-4306-86c3-67acf3b7e4ba admin admin] PATH_INFO: `/v3/projects/46d8d54c46ba42e6aecf3954bb2a2773/users/dd7331df1d5b456086891b9ccd403ed6/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.558966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9972b7-a306-4306-86c3-67acf3b7e4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d8d54c46ba42e6aecf3954bb2a2773, user_id=dd7331df1d5b456086891b9ccd403ed6, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.562105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9972b7-a306-4306-86c3-67acf3b7e4ba admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.650031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1108/2214] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:15:36 2022] PUT /identity/v3/projects/46d8d54c46ba42e6aecf3954bb2a2773/users/dd7331df1d5b456086891b9ccd403ed6/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:15:36.662442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e843662-94fe-4eb6-8a77-48fde0a3c08b None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.662771 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e843662-94fe-4eb6-8a77-48fde0a3c08b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.663056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e843662-94fe-4eb6-8a77-48fde0a3c08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.691077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-4e843662-94fe-4eb6-8a77-48fde0a3c08b None None] MFA Rules not processed for user `dd7331df1d5b456086891b9ccd403ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:36.692333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4e843662-94fe-4eb6-8a77-48fde0a3c08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:36.697636 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:36.759937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1107/2215] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:36.773186 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9972b7-a306-4306-86c3-67acf3b7e4ba admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.774990 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fe9972b7-a306-4306-86c3-67acf3b7e4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:36.860000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9972b7-a306-4306-86c3-67acf3b7e4ba admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.863880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a07e28-0c52-4ca1-bc6d-2e6291f01de1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.864538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07e28-0c52-4ca1-bc6d-2e6291f01de1 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.864824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07e28-0c52-4ca1-bc6d-2e6291f01de1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.865111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07e28-0c52-4ca1-bc6d-2e6291f01de1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.875156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a07e28-0c52-4ca1-bc6d-2e6291f01de1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.876730 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a07e28-0c52-4ca1-bc6d-2e6291f01de1 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:36.887206 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1109/2216] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:15:36.913699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e843662-94fe-4eb6-8a77-48fde0a3c08b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:36.974655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e843662-94fe-4eb6-8a77-48fde0a3c08b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:36.979187 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:36.980071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:36.980359 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:36.980638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] PATH_INFO: `/v3/users/dd7331df1d5b456086891b9ccd403ed6` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:36.981837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd7331df1d5b456086891b9ccd403ed6)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:36.983819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:37.152840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd7331df1d5b456086891b9ccd403ed6'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:37.164811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd7331df1d5b456086891b9ccd403ed6'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:37.165529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd7331df1d5b456086891b9ccd403ed6'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:37.172586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd7331df1d5b456086891b9ccd403ed6'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:37.173229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd7331df1d5b456086891b9ccd403ed6'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:37.253815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1108/2217] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:15:36 2022] DELETE /identity/v3/users/dd7331df1d5b456086891b9ccd403ed6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:15:37.258386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59beba-297b-43ef-bcd1-93dad1b5606f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:37.258711 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59beba-297b-43ef-bcd1-93dad1b5606f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:37.258998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59beba-297b-43ef-bcd1-93dad1b5606f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:37.277704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bd59beba-297b-43ef-bcd1-93dad1b5606f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:37.278912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bd59beba-297b-43ef-bcd1-93dad1b5606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:37.352339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1110/2218] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:37.362334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:37.363819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:37.396668 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:37.424896 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc60a4-4877-4686-829d-5c1ed68df8da admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:37.428834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6f562-4b4e-47a6-a321-7a1ff982b26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:37.429489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6f562-4b4e-47a6-a321-7a1ff982b26e service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:37.429779 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6f562-4b4e-47a6-a321-7a1ff982b26e service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:37.430060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6f562-4b4e-47a6-a321-7a1ff982b26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:37.439739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6f562-4b4e-47a6-a321-7a1ff982b26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:37.441059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6f562-4b4e-47a6-a321-7a1ff982b26e service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:37.450719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1109/2219] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:38.016052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59beba-297b-43ef-bcd1-93dad1b5606f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:38.017987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bd59beba-297b-43ef-bcd1-93dad1b5606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:38.035560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59beba-297b-43ef-bcd1-93dad1b5606f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:38.044610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:38.045930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:38.046283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:38.046634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] PATH_INFO: `/v3/projects/46d8d54c46ba42e6aecf3954bb2a2773` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:38.047957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d8d54c46ba42e6aecf3954bb2a2773)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:38.049950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:38.154117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:38.162341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d8d54c46ba42e6aecf3954bb2a2773', 'request_id': 'req-8f894f74-0c27-48a4-affb-6304f66d8348'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:38.168357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d8d54c46ba42e6aecf3954bb2a2773', 'request_id': 'req-8f894f74-0c27-48a4-affb-6304f66d8348'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:38.175041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d8d54c46ba42e6aecf3954bb2a2773', 'request_id': 'req-8f894f74-0c27-48a4-affb-6304f66d8348'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:38.195304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383976-6249-468e-a91b-c042df6648bc None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:38.195628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383976-6249-468e-a91b-c042df6648bc None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:38.195916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca383976-6249-468e-a91b-c042df6648bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:38.213804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-ca383976-6249-468e-a91b-c042df6648bc None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:38.214991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ca383976-6249-468e-a91b-c042df6648bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:38.266802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] The token cache is being invalidate because project 46d8d54c46ba42e6aecf3954bb2a2773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:15:38.267096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:38.267860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:15:38.269713 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1111/2220] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:15:38 2022] DELETE /identity/v3/projects/46d8d54c46ba42e6aecf3954bb2a2773 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:15:38.270394 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1110/2221] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:15:38.283847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:38.289185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:38.383459 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f894f74-0c27-48a4-affb-6304f66d8348 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:38.389288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e238e5-cd53-4434-8396-61236e3d7595 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:38.390146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e238e5-cd53-4434-8396-61236e3d7595 service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:38.390493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e238e5-cd53-4434-8396-61236e3d7595 service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:38.390778 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e238e5-cd53-4434-8396-61236e3d7595 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:38.392765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-66e238e5-cd53-4434-8396-61236e3d7595 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:38.404448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e238e5-cd53-4434-8396-61236e3d7595 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:38.406129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e238e5-cd53-4434-8396-61236e3d7595 service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:38.415917 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1112/2222] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:15:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:15:39.882322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de3259-20d1-40b7-93da-87c02ef417e4 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:39.883189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de3259-20d1-40b7-93da-87c02ef417e4 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:39.883475 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de3259-20d1-40b7-93da-87c02ef417e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:39.909719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a5de3259-20d1-40b7-93da-87c02ef417e4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:39.910967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a5de3259-20d1-40b7-93da-87c02ef417e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:39.972643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1111/2223] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:39.989045 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e238e5-cd53-4434-8396-61236e3d7595 service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:39.990863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-66e238e5-cd53-4434-8396-61236e3d7595 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:40.082975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e238e5-cd53-4434-8396-61236e3d7595 service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:40.089324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850081c-23ff-4d97-aac7-cdb0e114a770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:40.090106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850081c-23ff-4d97-aac7-cdb0e114a770 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:40.090522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850081c-23ff-4d97-aac7-cdb0e114a770 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:40.090861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850081c-23ff-4d97-aac7-cdb0e114a770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:40.103884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850081c-23ff-4d97-aac7-cdb0e114a770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:40.105494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850081c-23ff-4d97-aac7-cdb0e114a770 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:40.120204 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1113/2224] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:49.964010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=66 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:50.115328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=81,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:15:52.189893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de3259-20d1-40b7-93da-87c02ef417e4 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:52.191294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a5de3259-20d1-40b7-93da-87c02ef417e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:52.282763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de3259-20d1-40b7-93da-87c02ef417e4 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:52.287929 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a98af-bf38-471d-a469-b5897b5dacaf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdf5c7049f8499b8a25c88fbf4cb795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:52.288567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a98af-bf38-471d-a469-b5897b5dacaf service placement] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:52.288938 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a98af-bf38-471d-a469-b5897b5dacaf service placement] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:52.289222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a98af-bf38-471d-a469-b5897b5dacaf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:52.291000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8f7a98af-bf38-471d-a469-b5897b5dacaf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:52.303025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a98af-bf38-471d-a469-b5897b5dacaf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:52.304627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a98af-bf38-471d-a469-b5897b5dacaf service placement] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:52.315414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1112/2225] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:54.724022 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d64a63-f5fe-4bcc-9df9-39b2afcd3328 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:54.724546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d64a63-f5fe-4bcc-9df9-39b2afcd3328 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:54.724643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d64a63-f5fe-4bcc-9df9-39b2afcd3328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:54.742713 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-63d64a63-f5fe-4bcc-9df9-39b2afcd3328 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:54.743940 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-63d64a63-f5fe-4bcc-9df9-39b2afcd3328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:54.751956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1114/2226] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 10:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:54.766625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a98af-bf38-471d-a469-b5897b5dacaf service placement] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:54.768048 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8f7a98af-bf38-471d-a469-b5897b5dacaf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:54.783419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a98af-bf38-471d-a469-b5897b5dacaf service placement] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:54.788874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d7a89-fe6d-40a9-9cd5-025ed586db40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:54.789508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7a89-fe6d-40a9-9cd5-025ed586db40 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:54.789799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7a89-fe6d-40a9-9cd5-025ed586db40 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:54.790082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d7a89-fe6d-40a9-9cd5-025ed586db40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:54.799066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d7a89-fe6d-40a9-9cd5-025ed586db40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:54.800696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d7a89-fe6d-40a9-9cd5-025ed586db40 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:54.810491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1113/2227] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:58.626020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51899621-e365-4696-80d0-051f398bda3e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:58.626511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51899621-e365-4696-80d0-051f398bda3e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:58.626730 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51899621-e365-4696-80d0-051f398bda3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:58.644895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-51899621-e365-4696-80d0-051f398bda3e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:58.646083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-51899621-e365-4696-80d0-051f398bda3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:58.654025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1115/2228] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 10:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:58.671708 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d7a89-fe6d-40a9-9cd5-025ed586db40 service nova] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:58.683838 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d7a89-fe6d-40a9-9cd5-025ed586db40 service nova] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:58.689529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135440a-5e7a-4375-8a8c-8bc5fbbd8ee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:58.690177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135440a-5e7a-4375-8a8c-8bc5fbbd8ee8 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:58.690461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135440a-5e7a-4375-8a8c-8bc5fbbd8ee8 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:58.690835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135440a-5e7a-4375-8a8c-8bc5fbbd8ee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:58.699012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135440a-5e7a-4375-8a8c-8bc5fbbd8ee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:58.703370 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135440a-5e7a-4375-8a8c-8bc5fbbd8ee8 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:58.710306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1114/2229] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:15:59.012791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd5dfe-6bc8-4e0b-a568-3332c87fa887 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:59.013089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd5dfe-6bc8-4e0b-a568-3332c87fa887 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:59.013379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd5dfe-6bc8-4e0b-a568-3332c87fa887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:59.034132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b1bd5dfe-6bc8-4e0b-a568-3332c87fa887 None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:15:59.037251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b1bd5dfe-6bc8-4e0b-a568-3332c87fa887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:15:59.042584 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1116/2230] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 2 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:15:59.056105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135440a-5e7a-4375-8a8c-8bc5fbbd8ee8 service nova] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:15:59.068649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135440a-5e7a-4375-8a8c-8bc5fbbd8ee8 service nova] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:15:59.074245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeb2bf-eace-4398-8543-b9e50afa5822 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:15:59.074934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeb2bf-eace-4398-8543-b9e50afa5822 service swift] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:15:59.075217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeb2bf-eace-4398-8543-b9e50afa5822 service swift] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:15:59.075493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdeb2bf-eace-4398-8543-b9e50afa5822 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:15:59.084879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdeb2bf-eace-4398-8543-b9e50afa5822 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:15:59.086480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdeb2bf-eace-4398-8543-b9e50afa5822 service swift] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:15:59.094398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1115/2231] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:15:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:16:02.896601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d944c2-5dec-46f9-921b-c87764cedb6c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:02.897174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d944c2-5dec-46f9-921b-c87764cedb6c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:02.897174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d944c2-5dec-46f9-921b-c87764cedb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:02.917191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-35d944c2-5dec-46f9-921b-c87764cedb6c None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:02.918298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-35d944c2-5dec-46f9-921b-c87764cedb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:02.927595 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1117/2232] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 10:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:02.941875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeb2bf-eace-4398-8543-b9e50afa5822 service swift] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:02.953667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdeb2bf-eace-4398-8543-b9e50afa5822 service swift] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:02.959172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e697bdd-9052-4d64-8cac-eae9c4093604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:02.959847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e697bdd-9052-4d64-8cac-eae9c4093604 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:02.960130 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e697bdd-9052-4d64-8cac-eae9c4093604 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:02.960406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e697bdd-9052-4d64-8cac-eae9c4093604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:02.968617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e697bdd-9052-4d64-8cac-eae9c4093604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:02.970718 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e697bdd-9052-4d64-8cac-eae9c4093604 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:02.980730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1116/2233] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:16:06.139324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da8660-42f7-4d00-9de1-198fc85b175a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:06.139846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da8660-42f7-4d00-9de1-198fc85b175a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:06.139941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da8660-42f7-4d00-9de1-198fc85b175a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:06.159403 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-08da8660-42f7-4d00-9de1-198fc85b175a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:06.160630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-08da8660-42f7-4d00-9de1-198fc85b175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:06.168440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1118/2234] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 10:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:16:06.184263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e697bdd-9052-4d64-8cac-eae9c4093604 service nova] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:06.195947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e697bdd-9052-4d64-8cac-eae9c4093604 service nova] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:06.201372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775aff8e-5785-4ef4-9a22-03df73752e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:06.201999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aff8e-5785-4ef4-9a22-03df73752e56 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:06.202282 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aff8e-5785-4ef4-9a22-03df73752e56 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:06.202561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aff8e-5785-4ef4-9a22-03df73752e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:06.211524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775aff8e-5785-4ef4-9a22-03df73752e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:06.213234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775aff8e-5785-4ef4-9a22-03df73752e56 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:06.222744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1117/2235] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:16.154104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=15 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:16.218573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=71 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:26.996799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fc006-d1a7-4f9d-be07-bf8ba54368c1 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:26.996799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fc006-d1a7-4f9d-be07-bf8ba54368c1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:26.996799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fc006-d1a7-4f9d-be07-bf8ba54368c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:27.014641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f71fc006-d1a7-4f9d-be07-bf8ba54368c1 None None] MFA Rules not processed for user `ec08a55f3ec842cea121a5a7142b3d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:27.015885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f71fc006-d1a7-4f9d-be07-bf8ba54368c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:27.077666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1119/2236] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:16:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:28.844472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b8d8e-dbe3-443e-a029-4ab182ffc1ea None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:28.845061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b8d8e-dbe3-443e-a029-4ab182ffc1ea None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:28.845061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b8d8e-dbe3-443e-a029-4ab182ffc1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:28.869752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a13b8d8e-dbe3-443e-a029-4ab182ffc1ea None None] MFA Rules not processed for user `c7704f30352a4b7b8b8ee9019d86f50a`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:28.871008 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a13b8d8e-dbe3-443e-a029-4ab182ffc1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:28.931065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1118/2237] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:16:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:37.070594 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=25 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:38.924017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=25 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:16:46.210753 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba5c2-c5f7-407b-909e-3425e9d1a206 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:46.211285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba5c2-c5f7-407b-909e-3425e9d1a206 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:46.211368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ba5c2-c5f7-407b-909e-3425e9d1a206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:46.230777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7a8ba5c2-c5f7-407b-909e-3425e9d1a206 None None] MFA Rules not processed for user `378532c2b45a4b3b91857c0fc5cb8179`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:46.232199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7a8ba5c2-c5f7-407b-909e-3425e9d1a206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:46.293911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1120/2238] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:16:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:50.534770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a905-d294-4b62-88aa-a79053d81407 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:50.535801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a905-d294-4b62-88aa-a79053d81407 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:50.536351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a905-d294-4b62-88aa-a79053d81407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:50.558536 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-3e72a905-d294-4b62-88aa-a79053d81407 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:50.559891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-3e72a905-d294-4b62-88aa-a79053d81407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:50.571876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1119/2239] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 10:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:50.594915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ba5c2-c5f7-407b-909e-3425e9d1a206 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:50.609021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ba5c2-c5f7-407b-909e-3425e9d1a206 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:50.615004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f88d8-eec0-4032-b214-55071698fb83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:50.615778 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f88d8-eec0-4032-b214-55071698fb83 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:50.616065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f88d8-eec0-4032-b214-55071698fb83 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:50.616344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f88d8-eec0-4032-b214-55071698fb83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:50.624866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f88d8-eec0-4032-b214-55071698fb83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:50.626466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f88d8-eec0-4032-b214-55071698fb83 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:50.636954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1121/2240] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:55.156456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae62c1b-8a2b-45c7-8d86-ace6e29c66c9 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:55.157041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae62c1b-8a2b-45c7-8d86-ace6e29c66c9 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:55.157041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae62c1b-8a2b-45c7-8d86-ace6e29c66c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:55.181144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5ae62c1b-8a2b-45c7-8d86-ace6e29c66c9 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:55.181144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5ae62c1b-8a2b-45c7-8d86-ace6e29c66c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:55.186080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1120/2241] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 10:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:55.204421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f88d8-eec0-4032-b214-55071698fb83 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:55.216591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f88d8-eec0-4032-b214-55071698fb83 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:55.222167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc5791-8bc9-4ea8-81c1-03ef212573cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:55.222815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc5791-8bc9-4ea8-81c1-03ef212573cb service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:55.223093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc5791-8bc9-4ea8-81c1-03ef212573cb service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:55.223376 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc5791-8bc9-4ea8-81c1-03ef212573cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:55.232875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc5791-8bc9-4ea8-81c1-03ef212573cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:55.234486 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc5791-8bc9-4ea8-81c1-03ef212573cb service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:55.245479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1122/2242] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:16:57.498675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe74ee-fbd7-4d2c-83ed-23f8c2cf1282 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:57.499071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe74ee-fbd7-4d2c-83ed-23f8c2cf1282 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:57.499423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe74ee-fbd7-4d2c-83ed-23f8c2cf1282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:57.520676 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-2cfe74ee-fbd7-4d2c-83ed-23f8c2cf1282 None None] MFA Rules not processed for user `0439579b269b4fdd927ce404937ba204`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:57.522079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-2cfe74ee-fbd7-4d2c-83ed-23f8c2cf1282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:57.579266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1121/2243] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:16:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:16:58.972874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bad1f-7fea-4402-9aa1-338ab3d20cbd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:58.977674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bad1f-7fea-4402-9aa1-338ab3d20cbd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:58.977674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8bad1f-7fea-4402-9aa1-338ab3d20cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:58.992518 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ab8bad1f-7fea-4402-9aa1-338ab3d20cbd None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:16:58.993734 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ab8bad1f-7fea-4402-9aa1-338ab3d20cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:16:59.001891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1123/2244] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 10:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:16:59.017079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe74ee-fbd7-4d2c-83ed-23f8c2cf1282 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:16:59.029825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe74ee-fbd7-4d2c-83ed-23f8c2cf1282 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:16:59.035287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab1e76-8a3b-4e45-b4f7-a668b2a88110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:16:59.035978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1e76-8a3b-4e45-b4f7-a668b2a88110 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:16:59.036264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1e76-8a3b-4e45-b4f7-a668b2a88110 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:16:59.036547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab1e76-8a3b-4e45-b4f7-a668b2a88110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:16:59.046000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab1e76-8a3b-4e45-b4f7-a668b2a88110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:16:59.047659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab1e76-8a3b-4e45-b4f7-a668b2a88110 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:16:59.058801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1122/2245] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:17:04.384135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd61bd-9165-4b43-a54a-6a8bc5103007 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:04.387810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd61bd-9165-4b43-a54a-6a8bc5103007 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:04.387810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd61bd-9165-4b43-a54a-6a8bc5103007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:04.413120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-35cd61bd-9165-4b43-a54a-6a8bc5103007 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:04.414743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-35cd61bd-9165-4b43-a54a-6a8bc5103007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:04.426214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1124/2246] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 10:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:04.441146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab1e76-8a3b-4e45-b4f7-a668b2a88110 service nova] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:04.454457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab1e76-8a3b-4e45-b4f7-a668b2a88110 service nova] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:04.461561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aca75-3a8b-45f8-a88e-0fc6e1ae5a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:04.462362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aca75-3a8b-45f8-a88e-0fc6e1ae5a4d service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:04.462715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aca75-3a8b-45f8-a88e-0fc6e1ae5a4d service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:04.463065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674aca75-3a8b-45f8-a88e-0fc6e1ae5a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:04.474021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674aca75-3a8b-45f8-a88e-0fc6e1ae5a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:04.476543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674aca75-3a8b-45f8-a88e-0fc6e1ae5a4d service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:04.488395 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1123/2247] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:17:08.708458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427a17-c26f-4eab-b9df-0a2181ec37e6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:08.709709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427a17-c26f-4eab-b9df-0a2181ec37e6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:08.709709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427a17-c26f-4eab-b9df-0a2181ec37e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:08.716253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=44 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:08.730352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9e427a17-c26f-4eab-b9df-0a2181ec37e6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:08.731614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9e427a17-c26f-4eab-b9df-0a2181ec37e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:08.740549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1125/2248] 10.222.0.57 () {58 vars in 1016 bytes} [Thu Jun 2 10:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:08.758080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aca75-3a8b-45f8-a88e-0fc6e1ae5a4d service nova] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:08.770015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674aca75-3a8b-45f8-a88e-0fc6e1ae5a4d service nova] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:08.776231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3ac1-1cbc-4d9d-85ec-759bc5a53017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:08.776923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3ac1-1cbc-4d9d-85ec-759bc5a53017 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:08.777206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3ac1-1cbc-4d9d-85ec-759bc5a53017 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:08.777540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea3ac1-1cbc-4d9d-85ec-759bc5a53017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:08.786434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea3ac1-1cbc-4d9d-85ec-759bc5a53017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:08.788925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea3ac1-1cbc-4d9d-85ec-759bc5a53017 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:08.799964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1124/2249] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:17:09.291395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02203408-574d-4d18-9234-c74c9076043c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:09.291720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02203408-574d-4d18-9234-c74c9076043c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:09.292004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02203408-574d-4d18-9234-c74c9076043c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:09.310362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-02203408-574d-4d18-9234-c74c9076043c None None] MFA Rules not processed for user `b8ee3e13db3746d69529e75537b1cb66`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:09.311654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-02203408-574d-4d18-9234-c74c9076043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:09.368693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1126/2250] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:17:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:18.794911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=49 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:19.361123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=27 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:43.169879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3ac1-1cbc-4d9d-85ec-759bc5a53017 service nova] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:43.171857 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4fea3ac1-1cbc-4d9d-85ec-759bc5a53017 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:43.230158 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea3ac1-1cbc-4d9d-85ec-759bc5a53017 service nova] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:43.234459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35fafa-2bd4-40cc-982b-7b048355a560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:43.235106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35fafa-2bd4-40cc-982b-7b048355a560 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:43.235398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35fafa-2bd4-40cc-982b-7b048355a560 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:43.235704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35fafa-2bd4-40cc-982b-7b048355a560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:43.237494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6d35fafa-2bd4-40cc-982b-7b048355a560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:43.251454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35fafa-2bd4-40cc-982b-7b048355a560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:43.253036 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35fafa-2bd4-40cc-982b-7b048355a560 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:43.264769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1125/2251] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:17:43.538174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02203408-574d-4d18-9234-c74c9076043c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:43.539708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-02203408-574d-4d18-9234-c74c9076043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:43.553410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02203408-574d-4d18-9234-c74c9076043c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:43.557958 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15909db-0434-4351-9e43-109802068294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:43.558830 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15909db-0434-4351-9e43-109802068294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:43.559116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15909db-0434-4351-9e43-109802068294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:43.559417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15909db-0434-4351-9e43-109802068294 admin admin] PATH_INFO: `/v3/users/ec08a55f3ec842cea121a5a7142b3d8d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:43.561377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15909db-0434-4351-9e43-109802068294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec08a55f3ec842cea121a5a7142b3d8d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:43.563796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15909db-0434-4351-9e43-109802068294 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:43.868393 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-e15909db-0434-4351-9e43-109802068294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec08a55f3ec842cea121a5a7142b3d8d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:43.957253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-e15909db-0434-4351-9e43-109802068294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec08a55f3ec842cea121a5a7142b3d8d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:43.971732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-e15909db-0434-4351-9e43-109802068294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec08a55f3ec842cea121a5a7142b3d8d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:43.972445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-e15909db-0434-4351-9e43-109802068294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec08a55f3ec842cea121a5a7142b3d8d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:43.973057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-e15909db-0434-4351-9e43-109802068294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec08a55f3ec842cea121a5a7142b3d8d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:43.985815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1127/2252] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:17:43 2022] DELETE /identity/v3/users/ec08a55f3ec842cea121a5a7142b3d8d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:17:44.243895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35fafa-2bd4-40cc-982b-7b048355a560 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:44.255107 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35fafa-2bd4-40cc-982b-7b048355a560 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:44.323485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:44.324377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:44.324664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:44.324946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] PATH_INFO: `/v3/projects/69e7b26af0f44a81bfe790ca99a13e4e` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:44.326167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e7b26af0f44a81bfe790ca99a13e4e)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:44.328121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:44.456017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e7b26af0f44a81bfe790ca99a13e4e', 'request_id': 'req-ca47f6e8-c9d5-4a07-8777-365138d36c20'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:44.525127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e7b26af0f44a81bfe790ca99a13e4e', 'request_id': 'req-ca47f6e8-c9d5-4a07-8777-365138d36c20'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:44.532434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e7b26af0f44a81bfe790ca99a13e4e', 'request_id': 'req-ca47f6e8-c9d5-4a07-8777-365138d36c20'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:44.543837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] The token cache is being invalidate because project 69e7b26af0f44a81bfe790ca99a13e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:17:44.544135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:44.544862 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ca47f6e8-c9d5-4a07-8777-365138d36c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:44.546567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1126/2253] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:17:44 2022] DELETE /identity/v3/projects/69e7b26af0f44a81bfe790ca99a13e4e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:17:44.551602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3c6f8-91df-48d0-9f50-cb76e794318f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:44.552159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3c6f8-91df-48d0-9f50-cb76e794318f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:44.552335 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3c6f8-91df-48d0-9f50-cb76e794318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:44.575057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5ac3c6f8-91df-48d0-9f50-cb76e794318f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:44.577590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5ac3c6f8-91df-48d0-9f50-cb76e794318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:44.638756 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1128/2254] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:44.647000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4094-3f02-4b94-8b71-c2d33bdc67ba None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:44.647347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4094-3f02-4b94-8b71-c2d33bdc67ba None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:44.647572 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f4094-3f02-4b94-8b71-c2d33bdc67ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:44.677216 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-466f4094-3f02-4b94-8b71-c2d33bdc67ba None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:44.678439 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-466f4094-3f02-4b94-8b71-c2d33bdc67ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:44.686816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1127/2255] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:44.691355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3c6f8-91df-48d0-9f50-cb76e794318f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:44.701679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3c6f8-91df-48d0-9f50-cb76e794318f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:44.706608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa431cd-fe06-4f3d-868a-f3b4b6366cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:44.707289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa431cd-fe06-4f3d-868a-f3b4b6366cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:44.712046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa431cd-fe06-4f3d-868a-f3b4b6366cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:44.712046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa431cd-fe06-4f3d-868a-f3b4b6366cd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:44.712046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa431cd-fe06-4f3d-868a-f3b4b6366cd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:17:44.712046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa431cd-fe06-4f3d-868a-f3b4b6366cd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:44.712046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa431cd-fe06-4f3d-868a-f3b4b6366cd1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:44.723979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1129/2256] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:17:44.728319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4094-3f02-4b94-8b71-c2d33bdc67ba None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:44.738361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f4094-3f02-4b94-8b71-c2d33bdc67ba None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:44.743106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bd1e4-5ae6-492d-853b-6c9dd3d4fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:44.744129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bd1e4-5ae6-492d-853b-6c9dd3d4fd91 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:44.744420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bd1e4-5ae6-492d-853b-6c9dd3d4fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:44.744700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bd1e4-5ae6-492d-853b-6c9dd3d4fd91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:44.745388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bd1e4-5ae6-492d-853b-6c9dd3d4fd91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:44.747367 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bd1e4-5ae6-492d-853b-6c9dd3d4fd91 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:44.842591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1128/2257] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:17:44 2022] POST /identity/v3/projects => generated 397 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:17:44.852296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa431cd-fe06-4f3d-868a-f3b4b6366cd1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:44.863350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa431cd-fe06-4f3d-868a-f3b4b6366cd1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:44.935436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516ede9-dae1-42bf-ad15-82ebaf1ae698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:44.936343 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ede9-dae1-42bf-ad15-82ebaf1ae698 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:44.936730 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ede9-dae1-42bf-ad15-82ebaf1ae698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:44.937014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516ede9-dae1-42bf-ad15-82ebaf1ae698 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:44.938852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516ede9-dae1-42bf-ad15-82ebaf1ae698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:44.939837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516ede9-dae1-42bf-ad15-82ebaf1ae698 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:44.947106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:45.038716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1130/2258] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:17:44 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:17:45.042746 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bd1e4-5ae6-492d-853b-6c9dd3d4fd91 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:45.058412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:45.064181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bd1e4-5ae6-492d-853b-6c9dd3d4fd91 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:45.069340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c5556-7fe2-47c4-b041-f5cb2aaad2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:45.069972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c5556-7fe2-47c4-b041-f5cb2aaad2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:45.070260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c5556-7fe2-47c4-b041-f5cb2aaad2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:45.070596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c5556-7fe2-47c4-b041-f5cb2aaad2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:45.071366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c5556-7fe2-47c4-b041-f5cb2aaad2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:45.073017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c5556-7fe2-47c4-b041-f5cb2aaad2ac admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:45.085136 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1129/2259] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:17:45.089365 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516ede9-dae1-42bf-ad15-82ebaf1ae698 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:45.103457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516ede9-dae1-42bf-ad15-82ebaf1ae698 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:45.110626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e4fec-ebb1-487f-bf42-023468f7da94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:45.111776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e4fec-ebb1-487f-bf42-023468f7da94 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:45.112070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e4fec-ebb1-487f-bf42-023468f7da94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:45.112446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e4fec-ebb1-487f-bf42-023468f7da94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:45.113197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e4fec-ebb1-487f-bf42-023468f7da94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:45.115211 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e4fec-ebb1-487f-bf42-023468f7da94 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:45.132009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1131/2260] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:17:45.135186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c5556-7fe2-47c4-b041-f5cb2aaad2ac admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:45.148944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c5556-7fe2-47c4-b041-f5cb2aaad2ac admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:45.155482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3d250-1530-4f5c-a9f6-c29d1d994393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:45.158707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3d250-1530-4f5c-a9f6-c29d1d994393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:45.159087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3d250-1530-4f5c-a9f6-c29d1d994393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:45.159436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3d250-1530-4f5c-a9f6-c29d1d994393 admin admin] PATH_INFO: `/v3/projects/5162a09fa49440cf966fb441dae41bf7/users/8d1e349400ee46e8926c41ab78e3148e/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:45.176251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3d250-1530-4f5c-a9f6-c29d1d994393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5162a09fa49440cf966fb441dae41bf7, user_id=8d1e349400ee46e8926c41ab78e3148e, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:45.179995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3d250-1530-4f5c-a9f6-c29d1d994393 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:45.270388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1130/2261] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:17:45 2022] PUT /identity/v3/projects/5162a09fa49440cf966fb441dae41bf7/users/8d1e349400ee46e8926c41ab78e3148e/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:17:45.280941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4668bb-520b-485c-a247-7808643ab8c6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:45.281234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4668bb-520b-485c-a247-7808643ab8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:45.281515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4668bb-520b-485c-a247-7808643ab8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:45.329481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1e4668bb-520b-485c-a247-7808643ab8c6 None None] MFA Rules not processed for user `8d1e349400ee46e8926c41ab78e3148e`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:45.334608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1e4668bb-520b-485c-a247-7808643ab8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:45.415745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1132/2262] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:17:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:45.428240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3d250-1530-4f5c-a9f6-c29d1d994393 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:45.430122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-40d3d250-1530-4f5c-a9f6-c29d1d994393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:45.520523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3d250-1530-4f5c-a9f6-c29d1d994393 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:45.524831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cca0d-90e9-4bb3-ac0e-031690113dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:45.525647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cca0d-90e9-4bb3-ac0e-031690113dbd service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:45.526155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cca0d-90e9-4bb3-ac0e-031690113dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:45.526442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8cca0d-90e9-4bb3-ac0e-031690113dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:45.538774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cca0d-90e9-4bb3-ac0e-031690113dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:45.540330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8cca0d-90e9-4bb3-ac0e-031690113dbd service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:45.551727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1131/2263] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:17:46.637197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4668bb-520b-485c-a247-7808643ab8c6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:46.638689 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1e4668bb-520b-485c-a247-7808643ab8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:46.695098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4668bb-520b-485c-a247-7808643ab8c6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:46.698838 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0adf50-9edd-458a-949f-b5dc85a525ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:46.699489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0adf50-9edd-458a-949f-b5dc85a525ea service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:46.699803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0adf50-9edd-458a-949f-b5dc85a525ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:46.700086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0adf50-9edd-458a-949f-b5dc85a525ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:46.701955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8e0adf50-9edd-458a-949f-b5dc85a525ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:46.773679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0adf50-9edd-458a-949f-b5dc85a525ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:46.775109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0adf50-9edd-458a-949f-b5dc85a525ea service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:46.786336 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1133/2264] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:17:51.438557 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cca0d-90e9-4bb3-ac0e-031690113dbd service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:51.502286 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8cca0d-90e9-4bb3-ac0e-031690113dbd service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:51.507028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:51.507926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:51.508209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:51.508485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] PATH_INFO: `/v3/users/8d1e349400ee46e8926c41ab78e3148e` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:51.509676 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d1e349400ee46e8926c41ab78e3148e)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:51.511879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:51.750408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d1e349400ee46e8926c41ab78e3148e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:51.762657 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d1e349400ee46e8926c41ab78e3148e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:51.763357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d1e349400ee46e8926c41ab78e3148e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:51.771334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d1e349400ee46e8926c41ab78e3148e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:51.774639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d1e349400ee46e8926c41ab78e3148e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:51.774639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:51.864251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1132/2265] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:17:51 2022] DELETE /identity/v3/users/8d1e349400ee46e8926c41ab78e3148e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:17:51.869264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34f46e-eaca-4186-b61c-3f905d3ac454 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:51.871867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34f46e-eaca-4186-b61c-3f905d3ac454 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:51.872525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34f46e-eaca-4186-b61c-3f905d3ac454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:51.897615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ed34f46e-eaca-4186-b61c-3f905d3ac454 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:51.899255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ed34f46e-eaca-4186-b61c-3f905d3ac454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:51.905416 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:51.982902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1134/2266] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:17:52.008775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:52.016093 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:52.079957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef357d-11bc-4b4c-aeb5-1dfb062b2009 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:52.088151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d40410-9a25-4c6a-b4de-9485dae16dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:52.089118 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d40410-9a25-4c6a-b4de-9485dae16dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:52.089471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d40410-9a25-4c6a-b4de-9485dae16dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:52.089809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d40410-9a25-4c6a-b4de-9485dae16dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:52.101433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d40410-9a25-4c6a-b4de-9485dae16dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:52.107807 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d40410-9a25-4c6a-b4de-9485dae16dd6 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:52.118394 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1133/2267] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:17:52.646446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dd41-5790-45c2-80d2-9a0c0037b8e0 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:52.646739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dd41-5790-45c2-80d2-9a0c0037b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:52.647016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dd41-5790-45c2-80d2-9a0c0037b8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:52.665247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-51f6dd41-5790-45c2-80d2-9a0c0037b8e0 None None] MFA Rules not processed for user `c7704f30352a4b7b8b8ee9019d86f50a`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:52.666522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-51f6dd41-5790-45c2-80d2-9a0c0037b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:52.680865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d40410-9a25-4c6a-b4de-9485dae16dd6 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:52.682367 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-19d40410-9a25-4c6a-b4de-9485dae16dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:52.708662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d40410-9a25-4c6a-b4de-9485dae16dd6 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:52.715540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:52.716545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:52.716838 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:52.717156 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] PATH_INFO: `/v3/projects/5162a09fa49440cf966fb441dae41bf7` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:52.719063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5162a09fa49440cf966fb441dae41bf7)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:52.721109 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:52.739438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1135/2268] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:17:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:52.806830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5162a09fa49440cf966fb441dae41bf7', 'request_id': 'req-f45b670b-1b97-4289-b514-77412f27d0d4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:52.877542 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5162a09fa49440cf966fb441dae41bf7', 'request_id': 'req-f45b670b-1b97-4289-b514-77412f27d0d4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:52.884690 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5162a09fa49440cf966fb441dae41bf7', 'request_id': 'req-f45b670b-1b97-4289-b514-77412f27d0d4'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:52.898194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] The token cache is being invalidate because project 5162a09fa49440cf966fb441dae41bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:17:52.898194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:52.898194 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f45b670b-1b97-4289-b514-77412f27d0d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:17:52.898565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1134/2269] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:17:52 2022] DELETE /identity/v3/projects/5162a09fa49440cf966fb441dae41bf7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:17:52.903163 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e3483-90db-4cbe-92aa-76e036654f78 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:52.903649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e3483-90db-4cbe-92aa-76e036654f78 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:52.903877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e3483-90db-4cbe-92aa-76e036654f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:52.923442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c75e3483-90db-4cbe-92aa-76e036654f78 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:52.927002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c75e3483-90db-4cbe-92aa-76e036654f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:52.989043 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1136/2270] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:17:52.997024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655cd29-b7e3-4576-8e73-3431cdfd4ece None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:52.997546 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655cd29-b7e3-4576-8e73-3431cdfd4ece None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:52.998285 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655cd29-b7e3-4576-8e73-3431cdfd4ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:53.018506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c655cd29-b7e3-4576-8e73-3431cdfd4ece None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:53.019875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c655cd29-b7e3-4576-8e73-3431cdfd4ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:53.027985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1135/2271] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:17:53.033013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e3483-90db-4cbe-92aa-76e036654f78 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:53.042658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e3483-90db-4cbe-92aa-76e036654f78 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:53.048169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4419d72-0c4d-4faf-94a4-2360133aa97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:53.048837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419d72-0c4d-4faf-94a4-2360133aa97e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:53.049122 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419d72-0c4d-4faf-94a4-2360133aa97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:53.049405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419d72-0c4d-4faf-94a4-2360133aa97e admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:53.050142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4419d72-0c4d-4faf-94a4-2360133aa97e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:17:53.050457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4419d72-0c4d-4faf-94a4-2360133aa97e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:53.052116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4419d72-0c4d-4faf-94a4-2360133aa97e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:53.064570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1137/2272] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:17:53.074347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655cd29-b7e3-4576-8e73-3431cdfd4ece None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:53.084704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655cd29-b7e3-4576-8e73-3431cdfd4ece None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:53.092634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdfdd6-3a79-4c25-a56d-f0d356a83e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:53.093408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdfdd6-3a79-4c25-a56d-f0d356a83e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:53.093700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdfdd6-3a79-4c25-a56d-f0d356a83e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:53.093984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdfdd6-3a79-4c25-a56d-f0d356a83e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:53.094688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdfdd6-3a79-4c25-a56d-f0d356a83e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:53.096714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdfdd6-3a79-4c25-a56d-f0d356a83e97 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:53.175877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1136/2273] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:17:53 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:17:53.179835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4419d72-0c4d-4faf-94a4-2360133aa97e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:53.193197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4419d72-0c4d-4faf-94a4-2360133aa97e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:53.245507 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:53.265629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854565b-6210-4f3a-9671-87da41d23e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:53.266888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854565b-6210-4f3a-9671-87da41d23e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:53.267524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854565b-6210-4f3a-9671-87da41d23e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:53.268009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854565b-6210-4f3a-9671-87da41d23e07 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:53.269084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854565b-6210-4f3a-9671-87da41d23e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:53.271017 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854565b-6210-4f3a-9671-87da41d23e07 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:53.342452 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1138/2274] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:17:53 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:17:53.346498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdfdd6-3a79-4c25-a56d-f0d356a83e97 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:53.356798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdfdd6-3a79-4c25-a56d-f0d356a83e97 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:53.362006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d28cf4-4f2f-4a68-9ab4-2eab10b4b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:53.362664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d28cf4-4f2f-4a68-9ab4-2eab10b4b064 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:53.363010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d28cf4-4f2f-4a68-9ab4-2eab10b4b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:53.363292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d28cf4-4f2f-4a68-9ab4-2eab10b4b064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:53.364105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d28cf4-4f2f-4a68-9ab4-2eab10b4b064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:53.366098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d28cf4-4f2f-4a68-9ab4-2eab10b4b064 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:53.377164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1137/2275] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:17:53.381164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854565b-6210-4f3a-9671-87da41d23e07 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:53.391460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854565b-6210-4f3a-9671-87da41d23e07 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:53.400091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1021a-b64a-437c-868f-1a1ae5d3b7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:53.400091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1021a-b64a-437c-868f-1a1ae5d3b7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:53.400091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1021a-b64a-437c-868f-1a1ae5d3b7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:53.400091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1021a-b64a-437c-868f-1a1ae5d3b7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:53.400430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1021a-b64a-437c-868f-1a1ae5d3b7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:53.400430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1021a-b64a-437c-868f-1a1ae5d3b7d6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:53.416405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1139/2276] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:17:53.420877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d28cf4-4f2f-4a68-9ab4-2eab10b4b064 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:53.430381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1021a-b64a-437c-868f-1a1ae5d3b7d6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:53.432125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8fd1021a-b64a-437c-868f-1a1ae5d3b7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:53.432968 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d28cf4-4f2f-4a68-9ab4-2eab10b4b064 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:53.438445 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190bc3b-5200-4ac4-80ba-56867066e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:53.439774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190bc3b-5200-4ac4-80ba-56867066e087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:53.440135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190bc3b-5200-4ac4-80ba-56867066e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:53.440419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190bc3b-5200-4ac4-80ba-56867066e087 admin admin] PATH_INFO: `/v3/projects/d56c46e9755241f9bd42d00eed614d01/users/8f810c90892a4a58b072eb8cc6acb217/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:53.457233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190bc3b-5200-4ac4-80ba-56867066e087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56c46e9755241f9bd42d00eed614d01, user_id=8f810c90892a4a58b072eb8cc6acb217, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:53.460167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190bc3b-5200-4ac4-80ba-56867066e087 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:53.505003 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1021a-b64a-437c-868f-1a1ae5d3b7d6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:53.510148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4526ad2-1424-4f21-9b51-bed3410d7b82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdf5c7049f8499b8a25c88fbf4cb795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:53.510796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4526ad2-1424-4f21-9b51-bed3410d7b82 service placement] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:53.511086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4526ad2-1424-4f21-9b51-bed3410d7b82 service placement] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:53.511364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4526ad2-1424-4f21-9b51-bed3410d7b82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:53.513184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f4526ad2-1424-4f21-9b51-bed3410d7b82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:53.523838 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1138/2277] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:17:53 2022] PUT /identity/v3/projects/d56c46e9755241f9bd42d00eed614d01/users/8f810c90892a4a58b072eb8cc6acb217/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:17:53.528746 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e442d-e5a6-4f52-b8bd-c68b1fb24d94 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:53.529634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e442d-e5a6-4f52-b8bd-c68b1fb24d94 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:53.529930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e442d-e5a6-4f52-b8bd-c68b1fb24d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:53.532198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4526ad2-1424-4f21-9b51-bed3410d7b82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:53.533807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4526ad2-1424-4f21-9b51-bed3410d7b82 service placement] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:53.543864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1140/2278] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:17:53.547184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-3b2e442d-e5a6-4f52-b8bd-c68b1fb24d94 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:17:53.548401 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-3b2e442d-e5a6-4f52-b8bd-c68b1fb24d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:53.558570 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:17:53.609107 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1139/2279] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:17:53.618589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4526ad2-1424-4f21-9b51-bed3410d7b82 service placement] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:53.620032 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f4526ad2-1424-4f21-9b51-bed3410d7b82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:53.678726 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4526ad2-1424-4f21-9b51-bed3410d7b82 service placement] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:53.728921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f3fbd-b425-474c-a96d-7504586cdecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:53.729461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f3fbd-b425-474c-a96d-7504586cdecf service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:53.729867 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f3fbd-b425-474c-a96d-7504586cdecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:53.730158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f3fbd-b425-474c-a96d-7504586cdecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:53.739756 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f3fbd-b425-474c-a96d-7504586cdecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:53.741234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280f3fbd-b425-474c-a96d-7504586cdecf service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:53.751623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1141/2280] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:17:57.044978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e442d-e5a6-4f52-b8bd-c68b1fb24d94 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:57.061941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e442d-e5a6-4f52-b8bd-c68b1fb24d94 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:17:57.067879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6647e-2878-4459-9ae3-506963de3719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:17:57.068561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6647e-2878-4459-9ae3-506963de3719 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:17:57.068834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6647e-2878-4459-9ae3-506963de3719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:17:57.069591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6647e-2878-4459-9ae3-506963de3719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:17:57.073451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4bc6647e-2878-4459-9ae3-506963de3719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:57.091630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6647e-2878-4459-9ae3-506963de3719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:17:57.093332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6647e-2878-4459-9ae3-506963de3719 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:17:57.109081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1140/2281] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:17:59.868865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f3fbd-b425-474c-a96d-7504586cdecf service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:17:59.868865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-280f3fbd-b425-474c-a96d-7504586cdecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:17:59.906495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:00.025895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f3fbd-b425-474c-a96d-7504586cdecf service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:00.035794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924495-2d4b-4282-9440-e393953049e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:00.036491 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924495-2d4b-4282-9440-e393953049e8 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:00.037541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924495-2d4b-4282-9440-e393953049e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:00.037761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924495-2d4b-4282-9440-e393953049e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:00.040435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d3924495-2d4b-4282-9440-e393953049e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:00.127406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924495-2d4b-4282-9440-e393953049e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:00.129680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3924495-2d4b-4282-9440-e393953049e8 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:00.155846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1142/2282] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:17:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:00.292981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9784-1767-4bef-bfbc-b6ba668fe08d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:00.293533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9784-1767-4bef-bfbc-b6ba668fe08d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:00.293704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa9784-1767-4bef-bfbc-b6ba668fe08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:00.334922 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-62fa9784-1767-4bef-bfbc-b6ba668fe08d None None] MFA Rules not processed for user `8f810c90892a4a58b072eb8cc6acb217`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:00.337223 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-62fa9784-1767-4bef-bfbc-b6ba668fe08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:00.433983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1141/2283] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:00.438878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924495-2d4b-4282-9440-e393953049e8 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:00.449702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924495-2d4b-4282-9440-e393953049e8 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:00.456794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542034fb-d39a-47c4-a1f4-680a35ca9f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:00.457462 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542034fb-d39a-47c4-a1f4-680a35ca9f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:00.457748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542034fb-d39a-47c4-a1f4-680a35ca9f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:00.458642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542034fb-d39a-47c4-a1f4-680a35ca9f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:00.459741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542034fb-d39a-47c4-a1f4-680a35ca9f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:00.461414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542034fb-d39a-47c4-a1f4-680a35ca9f66 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:00.590144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1143/2284] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:00 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:00.594908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa9784-1767-4bef-bfbc-b6ba668fe08d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:00.607788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa9784-1767-4bef-bfbc-b6ba668fe08d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:00.688494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5fa10-b084-46f1-bda8-bdeedc1405d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:00.689321 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5fa10-b084-46f1-bda8-bdeedc1405d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:00.689678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5fa10-b084-46f1-bda8-bdeedc1405d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:00.690031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5fa10-b084-46f1-bda8-bdeedc1405d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:00.690830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5fa10-b084-46f1-bda8-bdeedc1405d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:00.693012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5fa10-b084-46f1-bda8-bdeedc1405d0 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:00.809987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1142/2285] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:00 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:18:00.814395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542034fb-d39a-47c4-a1f4-680a35ca9f66 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:00.828058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542034fb-d39a-47c4-a1f4-680a35ca9f66 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:00.849952 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338deb-573e-4a14-81ca-1d3df5d4ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:00.851433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338deb-573e-4a14-81ca-1d3df5d4ba09 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:00.853199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338deb-573e-4a14-81ca-1d3df5d4ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:00.854122 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd338deb-573e-4a14-81ca-1d3df5d4ba09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:00.855617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd338deb-573e-4a14-81ca-1d3df5d4ba09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:00.867606 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd338deb-573e-4a14-81ca-1d3df5d4ba09 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:00.899355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1144/2286] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:00.903432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5fa10-b084-46f1-bda8-bdeedc1405d0 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:00.919330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5fa10-b084-46f1-bda8-bdeedc1405d0 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:00.936579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269ecf-b99e-43e3-9a23-32fb96ca8bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:00.939059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269ecf-b99e-43e3-9a23-32fb96ca8bda admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:00.956105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269ecf-b99e-43e3-9a23-32fb96ca8bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:00.956706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61269ecf-b99e-43e3-9a23-32fb96ca8bda admin admin] PATH_INFO: `/v3/projects/c805ca4831eb4336843b11df5dcce618/users/753a421296604c7c994dd3d0f1ff02eb/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:01.009668 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61269ecf-b99e-43e3-9a23-32fb96ca8bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c805ca4831eb4336843b11df5dcce618, user_id=753a421296604c7c994dd3d0f1ff02eb, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:01.021593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61269ecf-b99e-43e3-9a23-32fb96ca8bda admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:01.034063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:01.129021 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1143/2287] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:00 2022] PUT /identity/v3/projects/c805ca4831eb4336843b11df5dcce618/users/753a421296604c7c994dd3d0f1ff02eb/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:01.134596 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338deb-573e-4a14-81ca-1d3df5d4ba09 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:01.152600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd338deb-573e-4a14-81ca-1d3df5d4ba09 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:01.253260 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455af60-6e8f-47b3-91fb-3c8dce46647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:01.253958 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455af60-6e8f-47b3-91fb-3c8dce46647a admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:01.254263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455af60-6e8f-47b3-91fb-3c8dce46647a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:01.254515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455af60-6e8f-47b3-91fb-3c8dce46647a admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:01.255256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455af60-6e8f-47b3-91fb-3c8dce46647a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:01.257002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455af60-6e8f-47b3-91fb-3c8dce46647a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:01.273368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1145/2288] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:01.274555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269ecf-b99e-43e3-9a23-32fb96ca8bda admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:01.290470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61269ecf-b99e-43e3-9a23-32fb96ca8bda admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:01.304706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08558340-cbb5-4fb0-9c39-95eab48cf276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:01.305791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08558340-cbb5-4fb0-9c39-95eab48cf276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:01.306134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08558340-cbb5-4fb0-9c39-95eab48cf276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:01.306660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08558340-cbb5-4fb0-9c39-95eab48cf276 admin admin] PATH_INFO: `/v3/projects/c805ca4831eb4336843b11df5dcce618/users/753a421296604c7c994dd3d0f1ff02eb/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:01.309465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08558340-cbb5-4fb0-9c39-95eab48cf276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c805ca4831eb4336843b11df5dcce618, user_id=753a421296604c7c994dd3d0f1ff02eb, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:01.312875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08558340-cbb5-4fb0-9c39-95eab48cf276 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:01.333558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1144/2289] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:01 2022] PUT /identity/v3/projects/c805ca4831eb4336843b11df5dcce618/users/753a421296604c7c994dd3d0f1ff02eb/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:03.604467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167c556-019a-4a1b-9329-335e6a6ec9b1 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:03.605039 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167c556-019a-4a1b-9329-335e6a6ec9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:03.605528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167c556-019a-4a1b-9329-335e6a6ec9b1 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:03.608092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1146/2290] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:18:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:18:03.647034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e9c2-ef30-42e0-b0c6-587bb6f71074 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:03.647612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e9c2-ef30-42e0-b0c6-587bb6f71074 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:03.647916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e9c2-ef30-42e0-b0c6-587bb6f71074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:03.691013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-0ad5e9c2-ef30-42e0-b0c6-587bb6f71074 None None] MFA Rules not processed for user `fbdf5c7049f8499b8a25c88fbf4cb795`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:03.692306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-0ad5e9c2-ef30-42e0-b0c6-587bb6f71074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:03.770517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1145/2291] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:18:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:03.800863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167c556-019a-4a1b-9329-335e6a6ec9b1 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:03.807714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3167c556-019a-4a1b-9329-335e6a6ec9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:03.829462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5e9c2-ef30-42e0-b0c6-587bb6f71074 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:03.838281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-0ad5e9c2-ef30-42e0-b0c6-587bb6f71074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:03.869243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167c556-019a-4a1b-9329-335e6a6ec9b1 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:03.886056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699042f-08ac-49ad-b00f-196b378df0cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdf5c7049f8499b8a25c88fbf4cb795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:03.886725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699042f-08ac-49ad-b00f-196b378df0cc service placement] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:03.888750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699042f-08ac-49ad-b00f-196b378df0cc service placement] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:03.894072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699042f-08ac-49ad-b00f-196b378df0cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:03.909197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:03.922354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699042f-08ac-49ad-b00f-196b378df0cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:03.922354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699042f-08ac-49ad-b00f-196b378df0cc service placement] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:03.939823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1147/2292] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:18:03.966157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5e9c2-ef30-42e0-b0c6-587bb6f71074 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:03.971175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:03.971992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:03.973827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:03.973827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] PATH_INFO: `/v3/users/378532c2b45a4b3b91857c0fc5cb8179` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:03.974230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] RBAC: Authorizing `identity:delete_user(user_id=378532c2b45a4b3b91857c0fc5cb8179)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:03.976605 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:04.220451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378532c2b45a4b3b91857c0fc5cb8179'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:04.238801 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378532c2b45a4b3b91857c0fc5cb8179'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:04.240226 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378532c2b45a4b3b91857c0fc5cb8179'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:04.244309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:04.251229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378532c2b45a4b3b91857c0fc5cb8179'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:04.252791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378532c2b45a4b3b91857c0fc5cb8179'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:04.340803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1146/2293] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:03 2022] DELETE /identity/v3/users/378532c2b45a4b3b91857c0fc5cb8179 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:04.735774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699042f-08ac-49ad-b00f-196b378df0cc service placement] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:04.737305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:04.739633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:04.749005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699042f-08ac-49ad-b00f-196b378df0cc service placement] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:04.823375 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:04.824537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:04.824971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:04.825457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] PATH_INFO: `/v3/projects/8927d95407e54fb2892aa038ce8d7525` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:04.827251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8927d95407e54fb2892aa038ce8d7525)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:04.829374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:04.877849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7a484-d9cc-4423-a16e-1e5b7057211e admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:04.887105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a456f28-2265-4a2d-bd2f-c5aad0f5adde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:04.888773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a456f28-2265-4a2d-bd2f-c5aad0f5adde service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:04.889368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a456f28-2265-4a2d-bd2f-c5aad0f5adde service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:04.889898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a456f28-2265-4a2d-bd2f-c5aad0f5adde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:04.892660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-2a456f28-2265-4a2d-bd2f-c5aad0f5adde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:05.004548 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a456f28-2265-4a2d-bd2f-c5aad0f5adde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:05.007985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a456f28-2265-4a2d-bd2f-c5aad0f5adde service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:05.020865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8927d95407e54fb2892aa038ce8d7525', 'request_id': 'req-a80df334-53dd-4c88-9023-8b41b6356022'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:05.036390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8927d95407e54fb2892aa038ce8d7525', 'request_id': 'req-a80df334-53dd-4c88-9023-8b41b6356022'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:05.039798 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1147/2294] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:05.048506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8927d95407e54fb2892aa038ce8d7525', 'request_id': 'req-a80df334-53dd-4c88-9023-8b41b6356022'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:05.175519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] The token cache is being invalidate because project 8927d95407e54fb2892aa038ce8d7525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:05.176179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:05.177468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a80df334-53dd-4c88-9023-8b41b6356022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:05.180052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1148/2295] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:04 2022] DELETE /identity/v3/projects/8927d95407e54fb2892aa038ce8d7525 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:05.185874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8fd9c-597e-47da-90f8-d9724be0ec56 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:05.186164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8fd9c-597e-47da-90f8-d9724be0ec56 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:05.186668 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8fd9c-597e-47da-90f8-d9724be0ec56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:05.225417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-16e8fd9c-597e-47da-90f8-d9724be0ec56 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:05.226673 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-16e8fd9c-597e-47da-90f8-d9724be0ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:05.341885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1148/2296] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:05.347648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd8cf4-ad7e-420f-a3f8-0d385e3ba6ba None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:05.347648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd8cf4-ad7e-420f-a3f8-0d385e3ba6ba None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:05.347648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd8cf4-ad7e-420f-a3f8-0d385e3ba6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:05.386352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-14cd8cf4-ad7e-420f-a3f8-0d385e3ba6ba None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:05.387572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-14cd8cf4-ad7e-420f-a3f8-0d385e3ba6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:05.404306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1149/2297] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:05.408023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8fd9c-597e-47da-90f8-d9724be0ec56 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:05.424610 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8fd9c-597e-47da-90f8-d9724be0ec56 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:05.430327 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14034b-d071-4d6d-b576-73bcf0b51990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:05.431238 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14034b-d071-4d6d-b576-73bcf0b51990 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:05.431362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14034b-d071-4d6d-b576-73bcf0b51990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:05.431599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14034b-d071-4d6d-b576-73bcf0b51990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:05.432649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14034b-d071-4d6d-b576-73bcf0b51990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:18:05.432883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14034b-d071-4d6d-b576-73bcf0b51990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:05.434653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14034b-d071-4d6d-b576-73bcf0b51990 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:05.471679 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1149/2298] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:18:05.475846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd8cf4-ad7e-420f-a3f8-0d385e3ba6ba None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:05.487515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd8cf4-ad7e-420f-a3f8-0d385e3ba6ba None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:05.502503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a8d2d-fbee-4cb9-b1db-928d459715fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:05.503370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a8d2d-fbee-4cb9-b1db-928d459715fa admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:05.503876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a8d2d-fbee-4cb9-b1db-928d459715fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:05.504329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a8d2d-fbee-4cb9-b1db-928d459715fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:05.505207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a8d2d-fbee-4cb9-b1db-928d459715fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:05.508544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a8d2d-fbee-4cb9-b1db-928d459715fa admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:05.633155 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1150/2299] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:05 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:05.634392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14034b-d071-4d6d-b576-73bcf0b51990 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:05.658741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14034b-d071-4d6d-b576-73bcf0b51990 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:05.671796 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:05.745184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc81ea0-4f58-4c65-8038-f4417952268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:05.746773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc81ea0-4f58-4c65-8038-f4417952268b admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:05.747418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc81ea0-4f58-4c65-8038-f4417952268b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:05.750917 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc81ea0-4f58-4c65-8038-f4417952268b admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:05.750917 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc81ea0-4f58-4c65-8038-f4417952268b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:05.752174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc81ea0-4f58-4c65-8038-f4417952268b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:05.840222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1150/2300] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:05 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:18:05.851687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a8d2d-fbee-4cb9-b1db-928d459715fa admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:05.868534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a8d2d-fbee-4cb9-b1db-928d459715fa admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:05.875321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcda3a-90ca-4387-b859-6c4bee331298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:05.879323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcda3a-90ca-4387-b859-6c4bee331298 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:05.879323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcda3a-90ca-4387-b859-6c4bee331298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:05.879323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcda3a-90ca-4387-b859-6c4bee331298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:05.879323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcda3a-90ca-4387-b859-6c4bee331298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:05.879724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcda3a-90ca-4387-b859-6c4bee331298 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:05.896001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1151/2301] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:05.897471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc81ea0-4f58-4c65-8038-f4417952268b admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:05.909394 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc81ea0-4f58-4c65-8038-f4417952268b admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:05.914632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce0104-bd56-4120-b08b-e4ce8bdf081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:05.915303 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0104-bd56-4120-b08b-e4ce8bdf081d admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:05.915614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0104-bd56-4120-b08b-e4ce8bdf081d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:05.915919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce0104-bd56-4120-b08b-e4ce8bdf081d admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:05.916652 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce0104-bd56-4120-b08b-e4ce8bdf081d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:05.918750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce0104-bd56-4120-b08b-e4ce8bdf081d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:05.934847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcda3a-90ca-4387-b859-6c4bee331298 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:05.939692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1151/2302] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:05.948673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcda3a-90ca-4387-b859-6c4bee331298 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:05.953814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191214ce-6b11-4a52-a117-1515866fc22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:05.954711 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191214ce-6b11-4a52-a117-1515866fc22e admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:05.954988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191214ce-6b11-4a52-a117-1515866fc22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:05.955446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191214ce-6b11-4a52-a117-1515866fc22e admin admin] PATH_INFO: `/v3/projects/fc3f25dfd025432ca64447eff9042907/users/314d9d35d53942a38505b6117ab4c07e/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:05.977173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191214ce-6b11-4a52-a117-1515866fc22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3f25dfd025432ca64447eff9042907, user_id=314d9d35d53942a38505b6117ab4c07e, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:05.980278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191214ce-6b11-4a52-a117-1515866fc22e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:06.053167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1152/2303] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:05 2022] PUT /identity/v3/projects/fc3f25dfd025432ca64447eff9042907/users/314d9d35d53942a38505b6117ab4c07e/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:18:06.065446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f7cb6-17a7-459b-8b3b-d03ff12d0c6b None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:06.065748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f7cb6-17a7-459b-8b3b-d03ff12d0c6b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:06.066159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f7cb6-17a7-459b-8b3b-d03ff12d0c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:06.103330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-112f7cb6-17a7-459b-8b3b-d03ff12d0c6b None None] MFA Rules not processed for user `314d9d35d53942a38505b6117ab4c07e`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:06.104682 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-112f7cb6-17a7-459b-8b3b-d03ff12d0c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:06.207347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1152/2304] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:06.214952 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191214ce-6b11-4a52-a117-1515866fc22e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:06.217836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-191214ce-6b11-4a52-a117-1515866fc22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:06.260764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:06.378247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191214ce-6b11-4a52-a117-1515866fc22e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:06.386554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0670d71-350f-4a90-b51a-a6cf6bb65276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:06.397253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0670d71-350f-4a90-b51a-a6cf6bb65276 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:06.398637 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0670d71-350f-4a90-b51a-a6cf6bb65276 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:06.398996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0670d71-350f-4a90-b51a-a6cf6bb65276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:06.409306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0670d71-350f-4a90-b51a-a6cf6bb65276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:06.410936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0670d71-350f-4a90-b51a-a6cf6bb65276 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:06.424719 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1153/2305] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:07.107486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f7cb6-17a7-459b-8b3b-d03ff12d0c6b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:07.107486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-112f7cb6-17a7-459b-8b3b-d03ff12d0c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:07.365815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f7cb6-17a7-459b-8b3b-d03ff12d0c6b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:07.382251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69212426-a1e4-4adc-92c6-5467ba7e7a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:07.382888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69212426-a1e4-4adc-92c6-5467ba7e7a69 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:07.383483 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69212426-a1e4-4adc-92c6-5467ba7e7a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:07.383483 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69212426-a1e4-4adc-92c6-5467ba7e7a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:07.385737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-69212426-a1e4-4adc-92c6-5467ba7e7a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:07.449794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69212426-a1e4-4adc-92c6-5467ba7e7a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:07.449794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69212426-a1e4-4adc-92c6-5467ba7e7a69 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:07.479047 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1153/2306] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:09.323106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532db4b9-edbe-4da9-af2f-fa6292005a65 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:09.323678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532db4b9-edbe-4da9-af2f-fa6292005a65 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:09.326143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532db4b9-edbe-4da9-af2f-fa6292005a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:09.385260 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-532db4b9-edbe-4da9-af2f-fa6292005a65 None None] MFA Rules not processed for user `753a421296604c7c994dd3d0f1ff02eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:09.386768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-532db4b9-edbe-4da9-af2f-fa6292005a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:09.499399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1154/2307] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:09 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:09.513222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69212426-a1e4-4adc-92c6-5467ba7e7a69 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:09.514667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-69212426-a1e4-4adc-92c6-5467ba7e7a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:09.534380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69212426-a1e4-4adc-92c6-5467ba7e7a69 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:09.538573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da15fe-d484-4872-bbba-af09b3589657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:09.539257 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da15fe-d484-4872-bbba-af09b3589657 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:09.539547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da15fe-d484-4872-bbba-af09b3589657 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:09.539862 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da15fe-d484-4872-bbba-af09b3589657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:09.541785 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-88da15fe-d484-4872-bbba-af09b3589657 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:09.567626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:09.612041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da15fe-d484-4872-bbba-af09b3589657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:09.614641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da15fe-d484-4872-bbba-af09b3589657 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:09.626584 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1154/2308] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:10.438153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532db4b9-edbe-4da9-af2f-fa6292005a65 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:10.524515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532db4b9-edbe-4da9-af2f-fa6292005a65 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:10.529012 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:10.530038 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:10.530329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:10.530608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] PATH_INFO: `/v3/users/314d9d35d53942a38505b6117ab4c07e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:10.531875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=314d9d35d53942a38505b6117ab4c07e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:10.533831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:10.774565 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:10.788654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314d9d35d53942a38505b6117ab4c07e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:10.850706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314d9d35d53942a38505b6117ab4c07e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:10.877299 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314d9d35d53942a38505b6117ab4c07e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:10.878356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314d9d35d53942a38505b6117ab4c07e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:10.878970 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314d9d35d53942a38505b6117ab4c07e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:10.896554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1155/2309] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:10 2022] DELETE /identity/v3/users/314d9d35d53942a38505b6117ab4c07e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:10.901074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bfa2a-50c6-420e-9e97-0e9cba7a032f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:10.901559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bfa2a-50c6-420e-9e97-0e9cba7a032f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:10.901793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bfa2a-50c6-420e-9e97-0e9cba7a032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:10.920594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b54bfa2a-50c6-420e-9e97-0e9cba7a032f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:10.922204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b54bfa2a-50c6-420e-9e97-0e9cba7a032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:11.026453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1155/2310] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:11.048367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:11.049790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:11.181647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50ca8a-107b-4985-9858-4f3a5ad69e6d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:11.185859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392b24e-5c1a-4f83-b84e-678529fda8a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:11.186722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392b24e-5c1a-4f83-b84e-678529fda8a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:11.187106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392b24e-5c1a-4f83-b84e-678529fda8a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:11.187482 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392b24e-5c1a-4f83-b84e-678529fda8a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:11.198462 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392b24e-5c1a-4f83-b84e-678529fda8a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:11.201434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392b24e-5c1a-4f83-b84e-678529fda8a4 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:11.212427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1156/2311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:11.812465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bfa2a-50c6-420e-9e97-0e9cba7a032f None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:11.813694 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b54bfa2a-50c6-420e-9e97-0e9cba7a032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:11.828817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54bfa2a-50c6-420e-9e97-0e9cba7a032f None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:11.835083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:11.836457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:11.837103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:11.837609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] PATH_INFO: `/v3/projects/fc3f25dfd025432ca64447eff9042907` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:11.839346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3f25dfd025432ca64447eff9042907)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:11.850768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:11.995299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3f25dfd025432ca64447eff9042907', 'request_id': 'req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:12.098121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392b24e-5c1a-4f83-b84e-678529fda8a4 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:12.100856 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9392b24e-5c1a-4f83-b84e-678529fda8a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:12.118304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3f25dfd025432ca64447eff9042907', 'request_id': 'req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:12.128144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3f25dfd025432ca64447eff9042907', 'request_id': 'req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:12.150846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] The token cache is being invalidate because project fc3f25dfd025432ca64447eff9042907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:12.152323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:12.154649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:12.157141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1156/2312] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:11 2022] DELETE /identity/v3/projects/fc3f25dfd025432ca64447eff9042907 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:12.159183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:12.161589 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:12.250834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:12.273631 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c5ff3-6f09-4ea7-a1ef-435da7446b8c admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:12.279627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd20cb-85e6-49b2-9795-7442c3c141d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:12.280123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392b24e-5c1a-4f83-b84e-678529fda8a4 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:12.280780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd20cb-85e6-49b2-9795-7442c3c141d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.281190 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd20cb-85e6-49b2-9795-7442c3c141d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.281547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd20cb-85e6-49b2-9795-7442c3c141d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.284414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-0ebd20cb-85e6-49b2-9795-7442c3c141d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:12.387416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd20cb-85e6-49b2-9795-7442c3c141d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:12.390096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd20cb-85e6-49b2-9795-7442c3c141d6 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:12.390264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:12.406293 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1157/2313] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:12.407985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4a6eb-2eab-4136-a8a4-873b62571171 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.408387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4a6eb-2eab-4136-a8a4-873b62571171 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.408741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4a6eb-2eab-4136-a8a4-873b62571171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.432626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f6be3-583a-4490-b772-7b1597cfa5b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:12.433298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f6be3-583a-4490-b772-7b1597cfa5b9 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.433467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-cdb4a6eb-2eab-4136-a8a4-873b62571171 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:12.433574 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f6be3-583a-4490-b772-7b1597cfa5b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.433844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f6be3-583a-4490-b772-7b1597cfa5b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.435949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-cdb4a6eb-2eab-4136-a8a4-873b62571171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:12.438956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-164f6be3-583a-4490-b772-7b1597cfa5b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:12.461096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f6be3-583a-4490-b772-7b1597cfa5b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:12.462734 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f6be3-583a-4490-b772-7b1597cfa5b9 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:12.485363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1157/2314] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:18:12.567625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1158/2315] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:12.571442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc3ec5-d0fb-4418-9ee4-12e559172938 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.571794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc3ec5-d0fb-4418-9ee4-12e559172938 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.572053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc3ec5-d0fb-4418-9ee4-12e559172938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.614197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a7fc3ec5-d0fb-4418-9ee4-12e559172938 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:12.615764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a7fc3ec5-d0fb-4418-9ee4-12e559172938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:12.657976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1158/2316] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:12.661129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4a6eb-2eab-4136-a8a4-873b62571171 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:12.675408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4a6eb-2eab-4136-a8a4-873b62571171 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:12.689706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a27ce-1592-4ced-8042-a1756d607974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:12.690585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a27ce-1592-4ced-8042-a1756d607974 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.690886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a27ce-1592-4ced-8042-a1756d607974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.691171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a27ce-1592-4ced-8042-a1756d607974 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.691947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a27ce-1592-4ced-8042-a1756d607974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:18:12.692267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a27ce-1592-4ced-8042-a1756d607974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:12.693905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a27ce-1592-4ced-8042-a1756d607974 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:12.790498 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc3ec5-d0fb-4418-9ee4-12e559172938 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:12.791922 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1159/2317] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:18:12.818261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc3ec5-d0fb-4418-9ee4-12e559172938 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:12.843876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ecade-261e-4a72-bb86-882de428e62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:12.844562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ecade-261e-4a72-bb86-882de428e62b admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:12.844850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ecade-261e-4a72-bb86-882de428e62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:12.845536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ecade-261e-4a72-bb86-882de428e62b admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:12.846253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ecade-261e-4a72-bb86-882de428e62b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:12.848246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ecade-261e-4a72-bb86-882de428e62b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:12.970597 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1159/2318] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:12 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:18:12.974141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a27ce-1592-4ced-8042-a1756d607974 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:12.988428 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a27ce-1592-4ced-8042-a1756d607974 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:13.133566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bb1fa-51e4-4730-8b7c-f0f6f3a2b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:13.135230 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bb1fa-51e4-4730-8b7c-f0f6f3a2b269 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:13.139132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bb1fa-51e4-4730-8b7c-f0f6f3a2b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:13.139860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bb1fa-51e4-4730-8b7c-f0f6f3a2b269 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:13.141987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bb1fa-51e4-4730-8b7c-f0f6f3a2b269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:13.148762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57bb1fa-51e4-4730-8b7c-f0f6f3a2b269 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:13.269908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1160/2319] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:12 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:18:13.273816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ecade-261e-4a72-bb86-882de428e62b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:13.288302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ecade-261e-4a72-bb86-882de428e62b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:13.300868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3315ae-006c-4a2a-976e-4263f6b3225f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:13.301421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3315ae-006c-4a2a-976e-4263f6b3225f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:13.301700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3315ae-006c-4a2a-976e-4263f6b3225f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:13.301976 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3315ae-006c-4a2a-976e-4263f6b3225f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:13.302712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3315ae-006c-4a2a-976e-4263f6b3225f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:13.304370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3315ae-006c-4a2a-976e-4263f6b3225f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:13.335737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1160/2320] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:18:13.335844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bb1fa-51e4-4730-8b7c-f0f6f3a2b269 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:13.347472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57bb1fa-51e4-4730-8b7c-f0f6f3a2b269 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:13.368400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ae6d8-a936-4027-8916-9f923caf42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:13.371263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ae6d8-a936-4027-8916-9f923caf42d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:13.371561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ae6d8-a936-4027-8916-9f923caf42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:13.372803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ae6d8-a936-4027-8916-9f923caf42d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:13.376004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ae6d8-a936-4027-8916-9f923caf42d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:13.378578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ae6d8-a936-4027-8916-9f923caf42d7 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:13.394693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1161/2321] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:13.398905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3315ae-006c-4a2a-976e-4263f6b3225f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:13.413064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3315ae-006c-4a2a-976e-4263f6b3225f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:13.427490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe16c2-bb8e-4d0f-becd-181dd433d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:13.428081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe16c2-bb8e-4d0f-becd-181dd433d52a admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:13.428366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe16c2-bb8e-4d0f-becd-181dd433d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:13.428647 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe16c2-bb8e-4d0f-becd-181dd433d52a admin admin] PATH_INFO: `/v3/projects/57b02f8bc3bf424493655d01bb4682de/users/59a1de339d394f4b87671862349c7946/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:13.453267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe16c2-bb8e-4d0f-becd-181dd433d52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b02f8bc3bf424493655d01bb4682de, user_id=59a1de339d394f4b87671862349c7946, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:13.461355 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe16c2-bb8e-4d0f-becd-181dd433d52a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:13.561680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1161/2322] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:13 2022] PUT /identity/v3/projects/57b02f8bc3bf424493655d01bb4682de/users/59a1de339d394f4b87671862349c7946/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:13.563022 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383326e-895f-4ec5-9a6e-ba8052cbd9d5 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:13.563553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383326e-895f-4ec5-9a6e-ba8052cbd9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:13.563865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383326e-895f-4ec5-9a6e-ba8052cbd9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:13.609101 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-9383326e-895f-4ec5-9a6e-ba8052cbd9d5 None None] MFA Rules not processed for user `59a1de339d394f4b87671862349c7946`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:13.610740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9383326e-895f-4ec5-9a6e-ba8052cbd9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:13.728054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1162/2323] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:13.740743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe16c2-bb8e-4d0f-becd-181dd433d52a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:13.742798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9bfe16c2-bb8e-4d0f-becd-181dd433d52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:13.874681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe16c2-bb8e-4d0f-becd-181dd433d52a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:13.883533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d907ae-8b20-46c0-bb8f-2734998aaa63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:13.884270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d907ae-8b20-46c0-bb8f-2734998aaa63 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:13.886261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d907ae-8b20-46c0-bb8f-2734998aaa63 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:13.886261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d907ae-8b20-46c0-bb8f-2734998aaa63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:13.894733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d907ae-8b20-46c0-bb8f-2734998aaa63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:13.896387 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d907ae-8b20-46c0-bb8f-2734998aaa63 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:13.913788 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1162/2324] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:13.969996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d0ba-fe15-46e5-bbaf-358eaf6945eb None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:13.970531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d0ba-fe15-46e5-bbaf-358eaf6945eb None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:13.970964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036d0ba-fe15-46e5-bbaf-358eaf6945eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:14.007752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7036d0ba-fe15-46e5-bbaf-358eaf6945eb None None] MFA Rules not processed for user `8f810c90892a4a58b072eb8cc6acb217`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:14.010395 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7036d0ba-fe15-46e5-bbaf-358eaf6945eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:14.088512 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1163/2325] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:14.182890 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d907ae-8b20-46c0-bb8f-2734998aaa63 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:14.240852 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:14.254765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d907ae-8b20-46c0-bb8f-2734998aaa63 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:14.259654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:14.260560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:14.260846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:14.261139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] PATH_INFO: `/v3/users/59a1de339d394f4b87671862349c7946` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:14.262328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a1de339d394f4b87671862349c7946)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:14.264413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:14.268751 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:14.453301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a1de339d394f4b87671862349c7946'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:14.599207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a1de339d394f4b87671862349c7946'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:14.612410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a1de339d394f4b87671862349c7946'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:14.613078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a1de339d394f4b87671862349c7946'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:14.613681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a1de339d394f4b87671862349c7946'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:14.626236 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1163/2326] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:14 2022] DELETE /identity/v3/users/59a1de339d394f4b87671862349c7946 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:14.630758 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374afe65-0670-488f-a488-f71070c7d890 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:14.631069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374afe65-0670-488f-a488-f71070c7d890 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:14.631368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374afe65-0670-488f-a488-f71070c7d890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:14.656379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-374afe65-0670-488f-a488-f71070c7d890 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:14.657585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-374afe65-0670-488f-a488-f71070c7d890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:14.717535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1164/2327] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:14.727245 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:14.728815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:14.788885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24a71f-d254-4229-8678-9b7f59d72df5 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:14.792631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde4014-83c0-4b30-87f7-ccc73fb87dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:14.793276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde4014-83c0-4b30-87f7-ccc73fb87dfd service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:14.793573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde4014-83c0-4b30-87f7-ccc73fb87dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:14.793839 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde4014-83c0-4b30-87f7-ccc73fb87dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:14.804399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde4014-83c0-4b30-87f7-ccc73fb87dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:14.805858 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde4014-83c0-4b30-87f7-ccc73fb87dfd service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:14.816581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1164/2328] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:15.353102 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374afe65-0670-488f-a488-f71070c7d890 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:15.355483 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-374afe65-0670-488f-a488-f71070c7d890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:15.373225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374afe65-0670-488f-a488-f71070c7d890 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:15.378418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:15.380509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:15.380975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:15.381257 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] PATH_INFO: `/v3/projects/57b02f8bc3bf424493655d01bb4682de` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:15.382577 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b02f8bc3bf424493655d01bb4682de)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:15.384496 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:15.498792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b02f8bc3bf424493655d01bb4682de', 'request_id': 'req-00304e37-6745-4c08-a918-428c5069b723'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:15.548766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:15.549545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b02f8bc3bf424493655d01bb4682de', 'request_id': 'req-00304e37-6745-4c08-a918-428c5069b723'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:15.556633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b02f8bc3bf424493655d01bb4682de', 'request_id': 'req-00304e37-6745-4c08-a918-428c5069b723'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:15.567671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] The token cache is being invalidate because project 57b02f8bc3bf424493655d01bb4682de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:15.567961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:15.568773 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-00304e37-6745-4c08-a918-428c5069b723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:15.570400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1165/2329] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:15 2022] DELETE /identity/v3/projects/57b02f8bc3bf424493655d01bb4682de => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:15.576282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4b3d-1b9c-44a6-9408-b1d50e8f1928 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:15.576282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4b3d-1b9c-44a6-9408-b1d50e8f1928 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:15.577117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f4b3d-1b9c-44a6-9408-b1d50e8f1928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:15.595836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c53f4b3d-1b9c-44a6-9408-b1d50e8f1928 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:15.596969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c53f4b3d-1b9c-44a6-9408-b1d50e8f1928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:15.665910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1165/2330] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:15.676817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d8fb0-1f27-4046-9f50-f73a406ee970 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:15.677323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d8fb0-1f27-4046-9f50-f73a406ee970 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:15.677957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d8fb0-1f27-4046-9f50-f73a406ee970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:15.702535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b66d8fb0-1f27-4046-9f50-f73a406ee970 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:15.703838 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b66d8fb0-1f27-4046-9f50-f73a406ee970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:15.711808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1166/2331] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:15.717009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4b3d-1b9c-44a6-9408-b1d50e8f1928 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:15.727157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f4b3d-1b9c-44a6-9408-b1d50e8f1928 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:15.732632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d453c-cce3-470b-b20b-eb81722dffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:15.733632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d453c-cce3-470b-b20b-eb81722dffee admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:15.733928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d453c-cce3-470b-b20b-eb81722dffee admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:15.734214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d453c-cce3-470b-b20b-eb81722dffee admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:15.734969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d453c-cce3-470b-b20b-eb81722dffee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:18:15.735270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d453c-cce3-470b-b20b-eb81722dffee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:15.736911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d453c-cce3-470b-b20b-eb81722dffee admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:15.751685 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1166/2332] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:18:15.754976 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d8fb0-1f27-4046-9f50-f73a406ee970 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:15.765819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d8fb0-1f27-4046-9f50-f73a406ee970 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:15.773379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ced69-ad70-4ccd-8b60-509e59c797b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:15.774180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ced69-ad70-4ccd-8b60-509e59c797b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:15.774612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ced69-ad70-4ccd-8b60-509e59c797b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:15.774895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ced69-ad70-4ccd-8b60-509e59c797b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:15.775659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ced69-ad70-4ccd-8b60-509e59c797b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:15.777559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ced69-ad70-4ccd-8b60-509e59c797b3 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:15.870927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1167/2333] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:15 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:15.875909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d453c-cce3-470b-b20b-eb81722dffee admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:15.887015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d453c-cce3-470b-b20b-eb81722dffee admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:15.893377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:15.949900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f86b68-4cf5-4445-b5dc-fb801c4e126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:15.950614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f86b68-4cf5-4445-b5dc-fb801c4e126b admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:15.951139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f86b68-4cf5-4445-b5dc-fb801c4e126b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:15.951482 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f86b68-4cf5-4445-b5dc-fb801c4e126b admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:15.952360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f86b68-4cf5-4445-b5dc-fb801c4e126b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:15.954328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f86b68-4cf5-4445-b5dc-fb801c4e126b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:16.079366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1167/2334] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:15 2022] POST /identity/v3/users => generated 282 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:16.083505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ced69-ad70-4ccd-8b60-509e59c797b3 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:16.095947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ced69-ad70-4ccd-8b60-509e59c797b3 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:16.102416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636389e-ec70-4a16-9577-03b8ca8c1546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:16.103087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636389e-ec70-4a16-9577-03b8ca8c1546 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:16.103532 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636389e-ec70-4a16-9577-03b8ca8c1546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:16.103704 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636389e-ec70-4a16-9577-03b8ca8c1546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:16.104496 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636389e-ec70-4a16-9577-03b8ca8c1546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:16.106125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636389e-ec70-4a16-9577-03b8ca8c1546 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:16.119106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1168/2335] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:18:16.124064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f86b68-4cf5-4445-b5dc-fb801c4e126b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:16.134221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f86b68-4cf5-4445-b5dc-fb801c4e126b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:16.139484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4360f-7dc0-442e-a58b-d11b2161ed2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:16.140191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4360f-7dc0-442e-a58b-d11b2161ed2b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:16.140483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4360f-7dc0-442e-a58b-d11b2161ed2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:16.142052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4360f-7dc0-442e-a58b-d11b2161ed2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:16.142799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4360f-7dc0-442e-a58b-d11b2161ed2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:16.144468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4360f-7dc0-442e-a58b-d11b2161ed2b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:16.157375 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1168/2336] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:16.161729 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636389e-ec70-4a16-9577-03b8ca8c1546 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:16.173190 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636389e-ec70-4a16-9577-03b8ca8c1546 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:16.179218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59b3ed-8e31-475f-871f-24690f9ccb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:16.180156 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59b3ed-8e31-475f-871f-24690f9ccb86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:16.180472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59b3ed-8e31-475f-871f-24690f9ccb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:16.180950 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59b3ed-8e31-475f-871f-24690f9ccb86 admin admin] PATH_INFO: `/v3/projects/1ef8232446f64989a570f6522de8e3a3/users/276a5705f14649d5b959c20462a19e62/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:16.195859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e27ac-0409-440c-a943-770c7e201bcb None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:16.196383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e27ac-0409-440c-a943-770c7e201bcb None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:16.196603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59b3ed-8e31-475f-871f-24690f9ccb86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef8232446f64989a570f6522de8e3a3, user_id=276a5705f14649d5b959c20462a19e62, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:16.197475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e27ac-0409-440c-a943-770c7e201bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:16.199463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59b3ed-8e31-475f-871f-24690f9ccb86 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:16.219507 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c06e27ac-0409-440c-a943-770c7e201bcb None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:16.220798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c06e27ac-0409-440c-a943-770c7e201bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:16.282663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1169/2337] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:18:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:16.317661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1169/2338] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:16 2022] PUT /identity/v3/projects/1ef8232446f64989a570f6522de8e3a3/users/276a5705f14649d5b959c20462a19e62/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:16.328175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef19f37-b63f-484b-9d4e-bea4206321ee None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:16.328468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef19f37-b63f-484b-9d4e-bea4206321ee None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:16.328747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef19f37-b63f-484b-9d4e-bea4206321ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:16.360918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-eef19f37-b63f-484b-9d4e-bea4206321ee None None] MFA Rules not processed for user `276a5705f14649d5b959c20462a19e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:16.362422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-eef19f37-b63f-484b-9d4e-bea4206321ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:16.442004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1170/2339] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:16.449373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59b3ed-8e31-475f-871f-24690f9ccb86 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:16.455985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef19f37-b63f-484b-9d4e-bea4206321ee None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:16.457427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-eef19f37-b63f-484b-9d4e-bea4206321ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:16.525406 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59b3ed-8e31-475f-871f-24690f9ccb86 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:16.535670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256ae94-b860-4839-b65f-0aa6f39527e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:16.536632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256ae94-b860-4839-b65f-0aa6f39527e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:16.536922 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256ae94-b860-4839-b65f-0aa6f39527e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:16.537203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256ae94-b860-4839-b65f-0aa6f39527e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:16.537912 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256ae94-b860-4839-b65f-0aa6f39527e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:16.540085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256ae94-b860-4839-b65f-0aa6f39527e8 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:16.556953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef19f37-b63f-484b-9d4e-bea4206321ee None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:16.563250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00241e-1d66-480b-9a24-d6ff5267c97f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:16.563992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00241e-1d66-480b-9a24-d6ff5267c97f service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:16.564273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00241e-1d66-480b-9a24-d6ff5267c97f service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:16.564657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00241e-1d66-480b-9a24-d6ff5267c97f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:16.629218 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00241e-1d66-480b-9a24-d6ff5267c97f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:16.631029 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00241e-1d66-480b-9a24-d6ff5267c97f service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:16.643093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1171/2340] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:18:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 10:18:16.658108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1170/2341] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:16 2022] POST /identity/v3/projects => generated 363 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:16.662146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00241e-1d66-480b-9a24-d6ff5267c97f service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:16.684920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00241e-1d66-480b-9a24-d6ff5267c97f service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:16.770199 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87344bdb-cc7d-4019-a9d5-06b73e2377f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:16.771063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87344bdb-cc7d-4019-a9d5-06b73e2377f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:16.771471 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87344bdb-cc7d-4019-a9d5-06b73e2377f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:16.771878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87344bdb-cc7d-4019-a9d5-06b73e2377f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:16.772700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87344bdb-cc7d-4019-a9d5-06b73e2377f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:16.778310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87344bdb-cc7d-4019-a9d5-06b73e2377f1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:16.868665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1172/2342] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:16 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:16.870458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256ae94-b860-4839-b65f-0aa6f39527e8 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:16.882258 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256ae94-b860-4839-b65f-0aa6f39527e8 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:16.889537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45aba1-92cd-4cff-8001-3252aafc6dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:16.890512 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45aba1-92cd-4cff-8001-3252aafc6dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:16.891014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45aba1-92cd-4cff-8001-3252aafc6dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:16.891736 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45aba1-92cd-4cff-8001-3252aafc6dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:16.892716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45aba1-92cd-4cff-8001-3252aafc6dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:16.894732 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45aba1-92cd-4cff-8001-3252aafc6dc4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:16.908451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1171/2343] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:16.913165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87344bdb-cc7d-4019-a9d5-06b73e2377f1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:16.931466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87344bdb-cc7d-4019-a9d5-06b73e2377f1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:16.939344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf09ec-80a6-4195-8b1d-f26f84245b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:16.939344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf09ec-80a6-4195-8b1d-f26f84245b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:16.939344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf09ec-80a6-4195-8b1d-f26f84245b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:16.939344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf09ec-80a6-4195-8b1d-f26f84245b7a admin admin] PATH_INFO: `/v3/projects/648f9d90862f4c6fa87f1d2dcb6ce90e/users/55d1250de687458a99cd4555676648e7/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:16.958923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf09ec-80a6-4195-8b1d-f26f84245b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=648f9d90862f4c6fa87f1d2dcb6ce90e, user_id=55d1250de687458a99cd4555676648e7, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:16.964310 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf09ec-80a6-4195-8b1d-f26f84245b7a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:17.044741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1173/2344] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:16 2022] PUT /identity/v3/projects/648f9d90862f4c6fa87f1d2dcb6ce90e/users/55d1250de687458a99cd4555676648e7/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:17.048871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45aba1-92cd-4cff-8001-3252aafc6dc4 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:17.064744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45aba1-92cd-4cff-8001-3252aafc6dc4 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:17.111910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:17.131342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:17.177289 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad20fc1-a679-4238-b176-82588c10c409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:17.178137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20fc1-a679-4238-b176-82588c10c409 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:17.178500 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20fc1-a679-4238-b176-82588c10c409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:17.178852 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad20fc1-a679-4238-b176-82588c10c409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:17.179696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad20fc1-a679-4238-b176-82588c10c409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:17.181803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad20fc1-a679-4238-b176-82588c10c409 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:17.193982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1172/2345] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:17.199595 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf09ec-80a6-4195-8b1d-f26f84245b7a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:17.210830 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf09ec-80a6-4195-8b1d-f26f84245b7a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:17.216674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a92d9e-4797-449e-bf3f-9e164219facc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:17.218629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92d9e-4797-449e-bf3f-9e164219facc admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:17.218990 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92d9e-4797-449e-bf3f-9e164219facc admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:17.219674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a92d9e-4797-449e-bf3f-9e164219facc admin admin] PATH_INFO: `/v3/projects/648f9d90862f4c6fa87f1d2dcb6ce90e/users/55d1250de687458a99cd4555676648e7/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:17.224654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a92d9e-4797-449e-bf3f-9e164219facc admin admin] RBAC: Authorizing `identity:create_grant(project_id=648f9d90862f4c6fa87f1d2dcb6ce90e, user_id=55d1250de687458a99cd4555676648e7, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:17.227418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a92d9e-4797-449e-bf3f-9e164219facc admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:17.243663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1174/2346] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:17 2022] PUT /identity/v3/projects/648f9d90862f4c6fa87f1d2dcb6ce90e/users/55d1250de687458a99cd4555676648e7/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:17.259200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1a90-31a5-4bc5-9c3a-6cedf2edcc40 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:17.259769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1a90-31a5-4bc5-9c3a-6cedf2edcc40 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:17.260306 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1a90-31a5-4bc5-9c3a-6cedf2edcc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:17.298651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-173f1a90-31a5-4bc5-9c3a-6cedf2edcc40 None None] MFA Rules not processed for user `55d1250de687458a99cd4555676648e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:17.300091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-173f1a90-31a5-4bc5-9c3a-6cedf2edcc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:17.394252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1173/2347] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:17 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:17.410875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a92d9e-4797-449e-bf3f-9e164219facc admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:17.412192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b7a92d9e-4797-449e-bf3f-9e164219facc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:17.441941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:17.489986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a92d9e-4797-449e-bf3f-9e164219facc admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:17.494431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ffd48-02ac-4d51-804c-aac983f6a823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:17.495241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ffd48-02ac-4d51-804c-aac983f6a823 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:17.495532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ffd48-02ac-4d51-804c-aac983f6a823 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:17.495903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ffd48-02ac-4d51-804c-aac983f6a823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:17.512679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ffd48-02ac-4d51-804c-aac983f6a823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:17.514426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ffd48-02ac-4d51-804c-aac983f6a823 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:17.526992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1175/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:17 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:17.791404 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f1a90-31a5-4bc5-9c3a-6cedf2edcc40 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:17.804284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f1a90-31a5-4bc5-9c3a-6cedf2edcc40 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:17.808511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace9a49-10d5-42af-bba1-7c8514499bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:17.809300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace9a49-10d5-42af-bba1-7c8514499bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:17.809647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace9a49-10d5-42af-bba1-7c8514499bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:17.810616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace9a49-10d5-42af-bba1-7c8514499bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:17.885298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace9a49-10d5-42af-bba1-7c8514499bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:17.886855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace9a49-10d5-42af-bba1-7c8514499bb7 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:17.901633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1174/2349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:17 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:26.567349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ffd48-02ac-4d51-804c-aac983f6a823 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:26.568962 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c33ffd48-02ac-4d51-804c-aac983f6a823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:26.709995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ffd48-02ac-4d51-804c-aac983f6a823 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:26.720602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8831bbb-5c4a-45d5-9636-7d566a67e50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:26.721419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831bbb-5c4a-45d5-9636-7d566a67e50a service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:26.721715 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831bbb-5c4a-45d5-9636-7d566a67e50a service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:26.722489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8831bbb-5c4a-45d5-9636-7d566a67e50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:26.737812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d8831bbb-5c4a-45d5-9636-7d566a67e50a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:26.761807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8831bbb-5c4a-45d5-9636-7d566a67e50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:26.761807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8831bbb-5c4a-45d5-9636-7d566a67e50a service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:26.794121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1176/2350] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:27.894202 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=77 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:28.754574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace9a49-10d5-42af-bba1-7c8514499bb7 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:28.822702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace9a49-10d5-42af-bba1-7c8514499bb7 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:28.828748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:28.829822 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:28.830286 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:28.830617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] PATH_INFO: `/v3/users/276a5705f14649d5b959c20462a19e62` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:28.831984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276a5705f14649d5b959c20462a19e62)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:28.833900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:29.074020 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276a5705f14649d5b959c20462a19e62'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:29.086693 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276a5705f14649d5b959c20462a19e62'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:29.087442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276a5705f14649d5b959c20462a19e62'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:29.095186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276a5705f14649d5b959c20462a19e62'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:29.095860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276a5705f14649d5b959c20462a19e62'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:29.197581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1175/2351] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:28 2022] DELETE /identity/v3/users/276a5705f14649d5b959c20462a19e62 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:29.202274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6bee6-ce77-41d3-bce4-7fc2d961d471 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:29.202769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6bee6-ce77-41d3-bce4-7fc2d961d471 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:29.202883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6bee6-ce77-41d3-bce4-7fc2d961d471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:29.220521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-39b6bee6-ce77-41d3-bce4-7fc2d961d471 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:29.221722 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-39b6bee6-ce77-41d3-bce4-7fc2d961d471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:29.283635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1177/2352] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:29.293571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:29.295824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:29.364638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567140f4-757a-4ee7-844d-beecc89f4896 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:29.368252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5ca58-6278-4d46-b523-498d9d620d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:29.368934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ca58-6278-4d46-b523-498d9d620d63 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:29.369218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ca58-6278-4d46-b523-498d9d620d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:29.371549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5ca58-6278-4d46-b523-498d9d620d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:29.378576 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5ca58-6278-4d46-b523-498d9d620d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:29.380043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5ca58-6278-4d46-b523-498d9d620d63 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:29.390183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1176/2353] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:29.968176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6bee6-ce77-41d3-bce4-7fc2d961d471 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:29.972837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-39b6bee6-ce77-41d3-bce4-7fc2d961d471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:29.982263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6bee6-ce77-41d3-bce4-7fc2d961d471 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:29.987852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:29.988859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:29.989150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:29.989426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] PATH_INFO: `/v3/projects/1ef8232446f64989a570f6522de8e3a3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:30.001153 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef8232446f64989a570f6522de8e3a3)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:30.003126 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:30.131512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:30.141340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef8232446f64989a570f6522de8e3a3', 'request_id': 'req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:30.148322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef8232446f64989a570f6522de8e3a3', 'request_id': 'req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:30.156375 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef8232446f64989a570f6522de8e3a3', 'request_id': 'req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:30.260990 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] The token cache is being invalidate because project 1ef8232446f64989a570f6522de8e3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:30.261619 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:30.261971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:30.264270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1178/2354] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:29 2022] DELETE /identity/v3/projects/1ef8232446f64989a570f6522de8e3a3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:30.274005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5ca58-6278-4d46-b523-498d9d620d63 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:30.285172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5ca58-6278-4d46-b523-498d9d620d63 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:30.304224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:30.346837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5301-cb10-43ef-af97-7ad3e1e00a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:30.347762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5301-cb10-43ef-af97-7ad3e1e00a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:30.348052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5301-cb10-43ef-af97-7ad3e1e00a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:30.348332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5301-cb10-43ef-af97-7ad3e1e00a6e admin admin] PATH_INFO: `/v3/users/55d1250de687458a99cd4555676648e7` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:30.349563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f5301-cb10-43ef-af97-7ad3e1e00a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d1250de687458a99cd4555676648e7)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:30.351551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f5301-cb10-43ef-af97-7ad3e1e00a6e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:30.431708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:30.433276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:30.491826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7c83c-7fe5-4260-9d95-3b9c46e7be43 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:30.495643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0408-db11-4d60-acbf-bfb42fc4289a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:30.496297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0408-db11-4d60-acbf-bfb42fc4289a service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:30.496594 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0408-db11-4d60-acbf-bfb42fc4289a service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:30.496858 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a0408-db11-4d60-acbf-bfb42fc4289a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:30.499602 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c94a0408-db11-4d60-acbf-bfb42fc4289a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:30.509426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a0408-db11-4d60-acbf-bfb42fc4289a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:30.510850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a0408-db11-4d60-acbf-bfb42fc4289a service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:30.519716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1179/2355] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:18:30.533719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a53f5301-cb10-43ef-af97-7ad3e1e00a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d1250de687458a99cd4555676648e7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:30.546411 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a53f5301-cb10-43ef-af97-7ad3e1e00a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d1250de687458a99cd4555676648e7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:30.547126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a53f5301-cb10-43ef-af97-7ad3e1e00a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d1250de687458a99cd4555676648e7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:30.553954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a53f5301-cb10-43ef-af97-7ad3e1e00a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d1250de687458a99cd4555676648e7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:30.555177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a53f5301-cb10-43ef-af97-7ad3e1e00a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d1250de687458a99cd4555676648e7'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:30.640181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1177/2356] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:30 2022] DELETE /identity/v3/users/55d1250de687458a99cd4555676648e7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:31.091982 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0408-db11-4d60-acbf-bfb42fc4289a service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:31.093431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c94a0408-db11-4d60-acbf-bfb42fc4289a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:31.117356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a0408-db11-4d60-acbf-bfb42fc4289a service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:31.195424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:31.196323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:31.196611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:31.196880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] PATH_INFO: `/v3/projects/648f9d90862f4c6fa87f1d2dcb6ce90e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:31.198148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] RBAC: Authorizing `identity:delete_project(project_id=648f9d90862f4c6fa87f1d2dcb6ce90e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:31.200104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:31.327264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '648f9d90862f4c6fa87f1d2dcb6ce90e', 'request_id': 'req-5394461d-e7e2-4109-bbce-d3bb7336063c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:31.337433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '648f9d90862f4c6fa87f1d2dcb6ce90e', 'request_id': 'req-5394461d-e7e2-4109-bbce-d3bb7336063c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:31.344816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '648f9d90862f4c6fa87f1d2dcb6ce90e', 'request_id': 'req-5394461d-e7e2-4109-bbce-d3bb7336063c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:31.412525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:31.416779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] The token cache is being invalidate because project 648f9d90862f4c6fa87f1d2dcb6ce90e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:31.417203 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:31.418209 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5394461d-e7e2-4109-bbce-d3bb7336063c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:31.420966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1180/2357] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:31 2022] DELETE /identity/v3/projects/648f9d90862f4c6fa87f1d2dcb6ce90e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:18:31.425858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64da98-283c-425f-b122-a66c06fa0da9 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:31.426330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64da98-283c-425f-b122-a66c06fa0da9 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:31.426428 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64da98-283c-425f-b122-a66c06fa0da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:31.444966 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-ee64da98-283c-425f-b122-a66c06fa0da9 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:31.446252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ee64da98-283c-425f-b122-a66c06fa0da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:31.506233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1178/2358] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:31.514531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04329-28a4-46db-857c-affb689ff42f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:31.514941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04329-28a4-46db-857c-affb689ff42f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:31.515307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e04329-28a4-46db-857c-affb689ff42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:31.535374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-58e04329-28a4-46db-857c-affb689ff42f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:31.536628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-58e04329-28a4-46db-857c-affb689ff42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:31.545661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1181/2359] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:31.549871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64da98-283c-425f-b122-a66c06fa0da9 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:31.559545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64da98-283c-425f-b122-a66c06fa0da9 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:31.564981 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e35f2a-e8be-4d6f-bf70-33378cfb25d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:31.565700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e35f2a-e8be-4d6f-bf70-33378cfb25d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:31.566056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e35f2a-e8be-4d6f-bf70-33378cfb25d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:31.566387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e35f2a-e8be-4d6f-bf70-33378cfb25d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:31.567237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e35f2a-e8be-4d6f-bf70-33378cfb25d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:18:31.567691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e35f2a-e8be-4d6f-bf70-33378cfb25d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:31.569343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e35f2a-e8be-4d6f-bf70-33378cfb25d1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:31.581540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1179/2360] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:18:31.585825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e04329-28a4-46db-857c-affb689ff42f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:31.596150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e04329-28a4-46db-857c-affb689ff42f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:31.600814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004515f-f7ff-4e30-aca6-a1d9e66c634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:31.601469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004515f-f7ff-4e30-aca6-a1d9e66c634e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:31.601758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004515f-f7ff-4e30-aca6-a1d9e66c634e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:31.602068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004515f-f7ff-4e30-aca6-a1d9e66c634e admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:31.602768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004515f-f7ff-4e30-aca6-a1d9e66c634e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:31.604708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8004515f-f7ff-4e30-aca6-a1d9e66c634e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:31.706967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1182/2361] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:31 2022] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:31.708221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e35f2a-e8be-4d6f-bf70-33378cfb25d1 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:31.720835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e35f2a-e8be-4d6f-bf70-33378cfb25d1 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:31.752244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:31.786493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262cca1-96da-4a51-bbfa-574607ec3cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:31.787256 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262cca1-96da-4a51-bbfa-574607ec3cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:31.787528 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262cca1-96da-4a51-bbfa-574607ec3cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:31.787835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262cca1-96da-4a51-bbfa-574607ec3cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:31.788522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262cca1-96da-4a51-bbfa-574607ec3cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:31.790440 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262cca1-96da-4a51-bbfa-574607ec3cd4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:31.938324 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1180/2362] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:31 2022] POST /identity/v3/users => generated 301 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:31.942523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004515f-f7ff-4e30-aca6-a1d9e66c634e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:31.953448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8004515f-f7ff-4e30-aca6-a1d9e66c634e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:31.957971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221d285-8f19-4f80-9101-befe1503ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:31.963132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221d285-8f19-4f80-9101-befe1503ad22 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:31.963132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221d285-8f19-4f80-9101-befe1503ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:31.963132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221d285-8f19-4f80-9101-befe1503ad22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:31.963132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221d285-8f19-4f80-9101-befe1503ad22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:31.963132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221d285-8f19-4f80-9101-befe1503ad22 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:31.971892 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1183/2363] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:31.975927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262cca1-96da-4a51-bbfa-574607ec3cd4 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:31.985934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262cca1-96da-4a51-bbfa-574607ec3cd4 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:31.990535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeb0a3-5f3c-4959-9f9a-d76fb721ea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:31.993949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeb0a3-5f3c-4959-9f9a-d76fb721ea9a admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:31.993949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeb0a3-5f3c-4959-9f9a-d76fb721ea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:31.993949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeb0a3-5f3c-4959-9f9a-d76fb721ea9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:31.993949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceeb0a3-5f3c-4959-9f9a-d76fb721ea9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:31.993949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceeb0a3-5f3c-4959-9f9a-d76fb721ea9a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:32.004479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1181/2364] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:32.008524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221d285-8f19-4f80-9101-befe1503ad22 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:32.019843 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221d285-8f19-4f80-9101-befe1503ad22 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:32.024505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f887a-b0e5-4ccf-9955-aecfde2d7cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:32.025430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f887a-b0e5-4ccf-9955-aecfde2d7cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:32.025717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f887a-b0e5-4ccf-9955-aecfde2d7cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:32.025990 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f887a-b0e5-4ccf-9955-aecfde2d7cfd admin admin] PATH_INFO: `/v3/projects/72589d3037d64037961ad4a8b6613d6e/users/01f77c3e05e64e269c9b88429270aa01/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:32.041621 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f887a-b0e5-4ccf-9955-aecfde2d7cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=72589d3037d64037961ad4a8b6613d6e, user_id=01f77c3e05e64e269c9b88429270aa01, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:32.045011 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f887a-b0e5-4ccf-9955-aecfde2d7cfd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:32.114603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1184/2365] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:32 2022] PUT /identity/v3/projects/72589d3037d64037961ad4a8b6613d6e/users/01f77c3e05e64e269c9b88429270aa01/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:32.125494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e7a3-6baa-4572-a9fd-d3db5b524ec4 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:32.125792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e7a3-6baa-4572-a9fd-d3db5b524ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:32.126078 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e7a3-6baa-4572-a9fd-d3db5b524ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:32.160081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-2569e7a3-6baa-4572-a9fd-d3db5b524ec4 None None] MFA Rules not processed for user `01f77c3e05e64e269c9b88429270aa01`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:32.161403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-2569e7a3-6baa-4572-a9fd-d3db5b524ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:32.240354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1182/2366] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:32.245053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f887a-b0e5-4ccf-9955-aecfde2d7cfd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:32.317878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f887a-b0e5-4ccf-9955-aecfde2d7cfd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:32.322935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc1700-ff3d-4223-bc67-89234113176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:32.323625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc1700-ff3d-4223-bc67-89234113176c admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:32.323913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc1700-ff3d-4223-bc67-89234113176c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:32.324185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc1700-ff3d-4223-bc67-89234113176c admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:32.324933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc1700-ff3d-4223-bc67-89234113176c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:32.326925 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc1700-ff3d-4223-bc67-89234113176c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:32.396050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1185/2367] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:32 2022] POST /identity/v3/projects => generated 399 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:32.400318 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569e7a3-6baa-4572-a9fd-d3db5b524ec4 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:32.413398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569e7a3-6baa-4572-a9fd-d3db5b524ec4 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:32.493937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019786c-cdea-4198-93f9-11f4f48c3c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:32.494698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019786c-cdea-4198-93f9-11f4f48c3c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:32.498742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019786c-cdea-4198-93f9-11f4f48c3c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:32.498742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019786c-cdea-4198-93f9-11f4f48c3c41 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:32.498742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019786c-cdea-4198-93f9-11f4f48c3c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:32.499075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019786c-cdea-4198-93f9-11f4f48c3c41 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:32.620547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1183/2368] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:32 2022] POST /identity/v3/users => generated 306 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:18:32.625341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc1700-ff3d-4223-bc67-89234113176c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:32.637204 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc1700-ff3d-4223-bc67-89234113176c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:32.643967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbb36a-180a-4caa-b451-5738d13784ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:32.644640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb36a-180a-4caa-b451-5738d13784ed admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:32.644930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb36a-180a-4caa-b451-5738d13784ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:32.645213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb36a-180a-4caa-b451-5738d13784ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:32.645954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbb36a-180a-4caa-b451-5738d13784ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:32.647573 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbb36a-180a-4caa-b451-5738d13784ed admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:32.659669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1186/2369] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:32.664102 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019786c-cdea-4198-93f9-11f4f48c3c41 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:32.675027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019786c-cdea-4198-93f9-11f4f48c3c41 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:32.679857 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0e71b-6e3a-4d6b-af43-fdb177a092f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:32.682995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0e71b-6e3a-4d6b-af43-fdb177a092f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:32.682995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0e71b-6e3a-4d6b-af43-fdb177a092f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:32.682995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0e71b-6e3a-4d6b-af43-fdb177a092f2 admin admin] PATH_INFO: `/v3/projects/17a0c7f838c549458c8dd0c0d2d07a19/users/3ea9827695494b7b89fb8c6293d388fe/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:32.696111 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0e71b-6e3a-4d6b-af43-fdb177a092f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a0c7f838c549458c8dd0c0d2d07a19, user_id=3ea9827695494b7b89fb8c6293d388fe, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:32.698745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0e71b-6e3a-4d6b-af43-fdb177a092f2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:32.821068 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1184/2370] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:32 2022] PUT /identity/v3/projects/17a0c7f838c549458c8dd0c0d2d07a19/users/3ea9827695494b7b89fb8c6293d388fe/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:32.825024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbb36a-180a-4caa-b451-5738d13784ed admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:32.836010 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbb36a-180a-4caa-b451-5738d13784ed admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:32.896147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368d183-8b4d-44ea-aa74-1283a1477976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:32.896753 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368d183-8b4d-44ea-aa74-1283a1477976 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:32.897038 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368d183-8b4d-44ea-aa74-1283a1477976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:32.897314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368d183-8b4d-44ea-aa74-1283a1477976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:32.898053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368d183-8b4d-44ea-aa74-1283a1477976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:32.899675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368d183-8b4d-44ea-aa74-1283a1477976 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:32.909585 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1187/2371] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:32.914366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0e71b-6e3a-4d6b-af43-fdb177a092f2 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:32.921222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:32.927403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0e71b-6e3a-4d6b-af43-fdb177a092f2 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:32.932124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1e3bd-e8f6-40bf-8229-0e49ec04a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:32.933011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e3bd-e8f6-40bf-8229-0e49ec04a86f admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:32.933296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e3bd-e8f6-40bf-8229-0e49ec04a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:32.933578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e3bd-e8f6-40bf-8229-0e49ec04a86f admin admin] PATH_INFO: `/v3/projects/17a0c7f838c549458c8dd0c0d2d07a19/users/3ea9827695494b7b89fb8c6293d388fe/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:32.936179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1e3bd-e8f6-40bf-8229-0e49ec04a86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a0c7f838c549458c8dd0c0d2d07a19, user_id=3ea9827695494b7b89fb8c6293d388fe, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:32.938820 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1e3bd-e8f6-40bf-8229-0e49ec04a86f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:32.950317 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1185/2372] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:32 2022] PUT /identity/v3/projects/17a0c7f838c549458c8dd0c0d2d07a19/users/3ea9827695494b7b89fb8c6293d388fe/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:18:32.961586 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d15d-9245-44c8-b9d2-2c8a5e761b39 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:32.961886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d15d-9245-44c8-b9d2-2c8a5e761b39 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:32.962168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d15d-9245-44c8-b9d2-2c8a5e761b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:32.976556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:33.000798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-38a8d15d-9245-44c8-b9d2-2c8a5e761b39 None None] MFA Rules not processed for user `3ea9827695494b7b89fb8c6293d388fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:33.002049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-38a8d15d-9245-44c8-b9d2-2c8a5e761b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:33.073451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1188/2373] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:33.087926 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1e3bd-e8f6-40bf-8229-0e49ec04a86f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:33.089724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-3aa1e3bd-e8f6-40bf-8229-0e49ec04a86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:33.158405 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1e3bd-e8f6-40bf-8229-0e49ec04a86f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:33.162208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca5eb7-4987-48fd-9a97-c4fe481d4ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:33.162885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca5eb7-4987-48fd-9a97-c4fe481d4ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:33.163174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca5eb7-4987-48fd-9a97-c4fe481d4ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:33.163461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca5eb7-4987-48fd-9a97-c4fe481d4ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:33.177962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca5eb7-4987-48fd-9a97-c4fe481d4ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:33.177962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca5eb7-4987-48fd-9a97-c4fe481d4ad3 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:33.185139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d15d-9245-44c8-b9d2-2c8a5e761b39 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:33.185561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1186/2374] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:33.186716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-38a8d15d-9245-44c8-b9d2-2c8a5e761b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:33.252900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d15d-9245-44c8-b9d2-2c8a5e761b39 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:33.256658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497417b-8d9e-4aea-af5f-bf284446ef47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:33.257306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497417b-8d9e-4aea-af5f-bf284446ef47 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:33.257592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497417b-8d9e-4aea-af5f-bf284446ef47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:33.257870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497417b-8d9e-4aea-af5f-bf284446ef47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:33.259671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a497417b-8d9e-4aea-af5f-bf284446ef47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:33.325692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497417b-8d9e-4aea-af5f-bf284446ef47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:33.327159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497417b-8d9e-4aea-af5f-bf284446ef47 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:33.337720 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1189/2375] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:18:33.454389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca5eb7-4987-48fd-9a97-c4fe481d4ad3 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:33.469270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca5eb7-4987-48fd-9a97-c4fe481d4ad3 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:33.477207 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b4470-5b7e-4e60-8fea-25981a11912b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:33.481942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4470-5b7e-4e60-8fea-25981a11912b service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:33.481942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4470-5b7e-4e60-8fea-25981a11912b service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:33.481942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b4470-5b7e-4e60-8fea-25981a11912b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:33.562633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b4470-5b7e-4e60-8fea-25981a11912b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:33.564231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b4470-5b7e-4e60-8fea-25981a11912b service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:33.574737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1187/2376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:34.436486 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497417b-8d9e-4aea-af5f-bf284446ef47 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:34.438014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a497417b-8d9e-4aea-af5f-bf284446ef47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:34.492298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:34.524721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497417b-8d9e-4aea-af5f-bf284446ef47 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:34.548773 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4c4fe-968e-4b62-94e9-944579314d12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:34.549604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4c4fe-968e-4b62-94e9-944579314d12 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:34.550016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4c4fe-968e-4b62-94e9-944579314d12 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:34.550362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4c4fe-968e-4b62-94e9-944579314d12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:34.553086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-edf4c4fe-968e-4b62-94e9-944579314d12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:34.592120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4c4fe-968e-4b62-94e9-944579314d12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:34.594519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4c4fe-968e-4b62-94e9-944579314d12 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:34.621024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1190/2377] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:34.919270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaeb5d-d6a4-4ae6-9762-d280bb6f891c None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:34.920333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaeb5d-d6a4-4ae6-9762-d280bb6f891c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:34.920865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaeb5d-d6a4-4ae6-9762-d280bb6f891c None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:34.923345 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1188/2378] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:18:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:18:34.931783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70651a-be6f-4e47-9045-7f5b0b7135be None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:34.932078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70651a-be6f-4e47-9045-7f5b0b7135be None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:34.932358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70651a-be6f-4e47-9045-7f5b0b7135be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:34.960321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2f70651a-be6f-4e47-9045-7f5b0b7135be None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:34.962016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2f70651a-be6f-4e47-9045-7f5b0b7135be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:34.977668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1191/2379] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:18:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:34.990525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaeb5d-d6a4-4ae6-9762-d280bb6f891c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:34.997872 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d3aaeb5d-d6a4-4ae6-9762-d280bb6f891c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:35.118974 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaeb5d-d6a4-4ae6-9762-d280bb6f891c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:35.125269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e7b5d-187e-4c57-a974-baf4a0b50adf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d089c711a94b70a198e35443ee7ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:35.126064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7b5d-187e-4c57-a974-baf4a0b50adf service glance] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:35.126603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7b5d-187e-4c57-a974-baf4a0b50adf service glance] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:35.126948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7b5d-187e-4c57-a974-baf4a0b50adf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:35.144172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e7b5d-187e-4c57-a974-baf4a0b50adf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:35.145719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e7b5d-187e-4c57-a974-baf4a0b50adf service glance] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:35.157923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1189/2380] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:35.454851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dad923-9688-4e42-9e59-1b9643e04063 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:35.454851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dad923-9688-4e42-9e59-1b9643e04063 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:35.454851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dad923-9688-4e42-9e59-1b9643e04063 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:35.454851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1192/2381] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:18:35.457508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69a4f-39f2-4580-93f7-ba98e51e3285 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:35.457804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69a4f-39f2-4580-93f7-ba98e51e3285 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:35.458083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69a4f-39f2-4580-93f7-ba98e51e3285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:35.493423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-cad69a4f-39f2-4580-93f7-ba98e51e3285 None None] MFA Rules not processed for user `d9263fa2ac534b7b9e5c6658c871da9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:35.495290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-cad69a4f-39f2-4580-93f7-ba98e51e3285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:35.515213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1190/2382] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:18:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:35.522880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dad923-9688-4e42-9e59-1b9643e04063 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:35.524692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-09dad923-9688-4e42-9e59-1b9643e04063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:35.560975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dad923-9688-4e42-9e59-1b9643e04063 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:35.566879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761e081-2bce-4a20-a377-a1d6ed9b94e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:35.567549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761e081-2bce-4a20-a377-a1d6ed9b94e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:35.567917 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761e081-2bce-4a20-a377-a1d6ed9b94e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:35.568212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761e081-2bce-4a20-a377-a1d6ed9b94e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:35.578966 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761e081-2bce-4a20-a377-a1d6ed9b94e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:35.581157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761e081-2bce-4a20-a377-a1d6ed9b94e2 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:35.592614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1193/2383] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:35.774391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0e12-ebbf-4496-a4ff-af48b94b92bb None None] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:35.774691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0e12-ebbf-4496-a4ff-af48b94b92bb None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:35.774986 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b0e12-ebbf-4496-a4ff-af48b94b92bb None None] PATH_INFO: `/` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:35.776972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1191/2384] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jun 2 10:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 10:18:35.786317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a356507-1bf9-4b40-93e2-53ec68acc1ca None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:35.789492 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a356507-1bf9-4b40-93e2-53ec68acc1ca None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:35.789492 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a356507-1bf9-4b40-93e2-53ec68acc1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:35.830761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0a356507-1bf9-4b40-93e2-53ec68acc1ca None None] MFA Rules not processed for user `ba690590103a4019a56b191e8dfe3231`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:35.832135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0a356507-1bf9-4b40-93e2-53ec68acc1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:35.881160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1194/2385] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jun 2 10:18:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:35.893253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b0e12-ebbf-4496-a4ff-af48b94b92bb None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:35.908462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b0e12-ebbf-4496-a4ff-af48b94b92bb None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:35.913784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ab9f7-aa84-4e7b-8a86-c231ee9099b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:35.914574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab9f7-aa84-4e7b-8a86-c231ee9099b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:35.914908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab9f7-aa84-4e7b-8a86-c231ee9099b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:35.915210 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ab9f7-aa84-4e7b-8a86-c231ee9099b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:35.929932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ab9f7-aa84-4e7b-8a86-c231ee9099b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:35.932880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ab9f7-aa84-4e7b-8a86-c231ee9099b8 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:35.960186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1192/2386] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:38.182856 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a356507-1bf9-4b40-93e2-53ec68acc1ca None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:38.184896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0a356507-1bf9-4b40-93e2-53ec68acc1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:38.207952 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a356507-1bf9-4b40-93e2-53ec68acc1ca None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:38.212575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:38.213443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:38.213733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:38.214016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] PATH_INFO: `/v3/users/b8ee3e13db3746d69529e75537b1cb66` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:38.215211 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ee3e13db3746d69529e75537b1cb66)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:38.217797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:38.413415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ee3e13db3746d69529e75537b1cb66'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:38.489263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ee3e13db3746d69529e75537b1cb66'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:38.505529 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ee3e13db3746d69529e75537b1cb66'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:38.506494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ee3e13db3746d69529e75537b1cb66'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:38.507170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ee3e13db3746d69529e75537b1cb66'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:38.520493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1195/2387] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:38 2022] DELETE /identity/v3/users/b8ee3e13db3746d69529e75537b1cb66 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:38.821692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ab9f7-aa84-4e7b-8a86-c231ee9099b8 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:38.848029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ab9f7-aa84-4e7b-8a86-c231ee9099b8 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:38.872893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:38.949470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:38.950878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:38.951225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:38.951560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] PATH_INFO: `/v3/projects/ab5b21f0ab724a4fb603a4dd912c6931` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:38.952866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5b21f0ab724a4fb603a4dd912c6931)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:38.954701 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:38.980663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:38.982195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:38.996179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3fb27-7744-472b-9623-3292ce88d522 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:39.001525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:39.002625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.002901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.003185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] PATH_INFO: `/v3/users/01f77c3e05e64e269c9b88429270aa01` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.004487 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f77c3e05e64e269c9b88429270aa01)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:39.006549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:39.078610 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5b21f0ab724a4fb603a4dd912c6931', 'request_id': 'req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:39.157571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5b21f0ab724a4fb603a4dd912c6931', 'request_id': 'req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:39.164240 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5b21f0ab724a4fb603a4dd912c6931', 'request_id': 'req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:39.175326 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] The token cache is being invalidate because project ab5b21f0ab724a4fb603a4dd912c6931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:39.175667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:39.176301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-e0a37516-07c4-4ed8-9a0f-159b3f9c535a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:39.177874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1193/2388] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:38 2022] DELETE /identity/v3/projects/ab5b21f0ab724a4fb603a4dd912c6931 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:39.182403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b99145-e5c4-4a13-9f58-9671a4b3c602 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.182701 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b99145-e5c4-4a13-9f58-9671a4b3c602 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.182980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b99145-e5c4-4a13-9f58-9671a4b3c602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.201375 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a6b99145-e5c4-4a13-9f58-9671a4b3c602 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:39.202598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a6b99145-e5c4-4a13-9f58-9671a4b3c602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:39.235903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f77c3e05e64e269c9b88429270aa01'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:39.264281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1194/2389] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:39.272374 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca694b0-9216-418e-9f5c-a77542b21992 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.272674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca694b0-9216-418e-9f5c-a77542b21992 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.272959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca694b0-9216-418e-9f5c-a77542b21992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.294880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-aca694b0-9216-418e-9f5c-a77542b21992 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:39.294880 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-aca694b0-9216-418e-9f5c-a77542b21992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:39.301479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1195/2390] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:39.305476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca694b0-9216-418e-9f5c-a77542b21992 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:39.307349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f77c3e05e64e269c9b88429270aa01'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:39.314724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca694b0-9216-418e-9f5c-a77542b21992 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:39.319046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:39.319569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8ceb1-604b-4fea-9910-626575bf9232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:39.320250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ceb1-604b-4fea-9910-626575bf9232 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.320562 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ceb1-604b-4fea-9910-626575bf9232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.320844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ceb1-604b-4fea-9910-626575bf9232 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.321567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8ceb1-604b-4fea-9910-626575bf9232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:18:39.321703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f77c3e05e64e269c9b88429270aa01'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:39.321882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8ceb1-604b-4fea-9910-626575bf9232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:39.322550 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f77c3e05e64e269c9b88429270aa01'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:39.323247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f77c3e05e64e269c9b88429270aa01'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:39.323501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8ceb1-604b-4fea-9910-626575bf9232 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:39.335923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1196/2391] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:18:39.336423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1196/2392] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:38 2022] DELETE /identity/v3/users/01f77c3e05e64e269c9b88429270aa01 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:39.340350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:39.341294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa590a5f-edfc-4cc9-8a11-3281f1fa49cc None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.341593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa590a5f-edfc-4cc9-8a11-3281f1fa49cc None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.341879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa590a5f-edfc-4cc9-8a11-3281f1fa49cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.342542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:39.359150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-aa590a5f-edfc-4cc9-8a11-3281f1fa49cc None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:39.360396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-aa590a5f-edfc-4cc9-8a11-3281f1fa49cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:39.383454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:39.415201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47db76-f5de-44a4-ab54-01ec3a18a639 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:39.420631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b0331-f9a5-4d3a-a2cc-a2559a579e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:39.421349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0331-f9a5-4d3a-a2cc-a2559a579e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.421667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0331-f9a5-4d3a-a2cc-a2559a579e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.421957 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b0331-f9a5-4d3a-a2cc-a2559a579e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.422739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b0331-f9a5-4d3a-a2cc-a2559a579e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:39.424741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b0331-f9a5-4d3a-a2cc-a2559a579e03 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:39.430484 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1197/2393] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:39.434204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550416f7-39f9-4b01-805b-2947cd05a8e7 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.435481 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550416f7-39f9-4b01-805b-2947cd05a8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.435919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550416f7-39f9-4b01-805b-2947cd05a8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.454386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-550416f7-39f9-4b01-805b-2947cd05a8e7 None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:39.455654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-550416f7-39f9-4b01-805b-2947cd05a8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:39.502262 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1197/2394] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:39 2022] POST /identity/v3/projects => generated 405 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:39.503176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b0331-f9a5-4d3a-a2cc-a2559a579e03 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:39.504783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-250b0331-f9a5-4d3a-a2cc-a2559a579e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:39.510715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1198/2395] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:39.511535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550416f7-39f9-4b01-805b-2947cd05a8e7 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:39.528080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550416f7-39f9-4b01-805b-2947cd05a8e7 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:39.564723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b0331-f9a5-4d3a-a2cc-a2559a579e03 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:39.568376 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97324f7b-0e14-43d4-9547-ca1f9f41425f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:39.569019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97324f7b-0e14-43d4-9547-ca1f9f41425f service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.569308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97324f7b-0e14-43d4-9547-ca1f9f41425f service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.569589 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97324f7b-0e14-43d4-9547-ca1f9f41425f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.586391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b70abd-6bb9-4922-8af5-e32f913274c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:39.587069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70abd-6bb9-4922-8af5-e32f913274c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.589168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70abd-6bb9-4922-8af5-e32f913274c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.589168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b70abd-6bb9-4922-8af5-e32f913274c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.589168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b70abd-6bb9-4922-8af5-e32f913274c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:39.590736 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b70abd-6bb9-4922-8af5-e32f913274c1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:39.632534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97324f7b-0e14-43d4-9547-ca1f9f41425f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:39.634020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97324f7b-0e14-43d4-9547-ca1f9f41425f service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:39.644545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1198/2396] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:39.645356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97324f7b-0e14-43d4-9547-ca1f9f41425f service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:39.646707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-97324f7b-0e14-43d4-9547-ca1f9f41425f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:39.670031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:39.674538 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1199/2397] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:39 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:39.678816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b70abd-6bb9-4922-8af5-e32f913274c1 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:39.691059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b70abd-6bb9-4922-8af5-e32f913274c1 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:39.699076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e870f-2554-4b68-b269-8bf7ebdaf319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:39.704763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e870f-2554-4b68-b269-8bf7ebdaf319 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.704763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e870f-2554-4b68-b269-8bf7ebdaf319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.704763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e870f-2554-4b68-b269-8bf7ebdaf319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.704763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e870f-2554-4b68-b269-8bf7ebdaf319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:39.704763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e870f-2554-4b68-b269-8bf7ebdaf319 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:39.719020 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1200/2398] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:39.720098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e870f-2554-4b68-b269-8bf7ebdaf319 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:39.723716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97324f7b-0e14-43d4-9547-ca1f9f41425f service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:39.729821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e01fc5-81df-4bab-8c27-97b3f5b07431 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:39.730485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e01fc5-81df-4bab-8c27-97b3f5b07431 service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.730771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e01fc5-81df-4bab-8c27-97b3f5b07431 service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.732924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e870f-2554-4b68-b269-8bf7ebdaf319 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:39.733111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e01fc5-81df-4bab-8c27-97b3f5b07431 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.736217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fd961-56a2-4f96-b29f-48f215067f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:39.737096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fd961-56a2-4f96-b29f-48f215067f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.737396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fd961-56a2-4f96-b29f-48f215067f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.738304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fd961-56a2-4f96-b29f-48f215067f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.738433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fd961-56a2-4f96-b29f-48f215067f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:39.740409 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fd961-56a2-4f96-b29f-48f215067f05 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:39.753146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1201/2399] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:18:39.757319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fd961-56a2-4f96-b29f-48f215067f05 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:39.768292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fd961-56a2-4f96-b29f-48f215067f05 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:39.773098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3670b-86bf-4fc5-ae74-16c537531057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:39.774046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3670b-86bf-4fc5-ae74-16c537531057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.774402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3670b-86bf-4fc5-ae74-16c537531057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.774752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3670b-86bf-4fc5-ae74-16c537531057 admin admin] PATH_INFO: `/v3/projects/47939607ad23427594aca1c660a0aa5d/users/964af50e111942d091c41431074259fb/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.790939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3670b-86bf-4fc5-ae74-16c537531057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47939607ad23427594aca1c660a0aa5d, user_id=964af50e111942d091c41431074259fb, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:39.791508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e01fc5-81df-4bab-8c27-97b3f5b07431 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:39.793150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e01fc5-81df-4bab-8c27-97b3f5b07431 service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:39.794592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3670b-86bf-4fc5-ae74-16c537531057 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:39.802586 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1199/2400] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:18:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:18:39.897269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1202/2401] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:39 2022] PUT /identity/v3/projects/47939607ad23427594aca1c660a0aa5d/users/964af50e111942d091c41431074259fb/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:18:39.902413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa878-1068-4fcc-9e19-33fdd9bb58bd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:39.902712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa878-1068-4fcc-9e19-33fdd9bb58bd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:39.903077 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa878-1068-4fcc-9e19-33fdd9bb58bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:39.923628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-44caa878-1068-4fcc-9e19-33fdd9bb58bd None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:39.924854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-44caa878-1068-4fcc-9e19-33fdd9bb58bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:40.056943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1200/2402] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:40.071092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3670b-86bf-4fc5-ae74-16c537531057 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:40.071092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-90e3670b-86bf-4fc5-ae74-16c537531057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:40.078745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa878-1068-4fcc-9e19-33fdd9bb58bd None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:40.080378 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-44caa878-1068-4fcc-9e19-33fdd9bb58bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:40.113881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa878-1068-4fcc-9e19-33fdd9bb58bd None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:40.119688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:40.133969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:40.133969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:40.133969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:40.133969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] PATH_INFO: `/v3/projects/72589d3037d64037961ad4a8b6613d6e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:40.142545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72589d3037d64037961ad4a8b6613d6e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:40.144843 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:40.225129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3670b-86bf-4fc5-ae74-16c537531057 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:40.237616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2e4ed-d773-4dda-9c95-d13f4e4d63b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:40.239311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2e4ed-d773-4dda-9c95-d13f4e4d63b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:40.239557 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2e4ed-d773-4dda-9c95-d13f4e4d63b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:40.240034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2e4ed-d773-4dda-9c95-d13f4e4d63b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:40.254317 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2e4ed-d773-4dda-9c95-d13f4e4d63b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:40.257032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2e4ed-d773-4dda-9c95-d13f4e4d63b1 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:40.272262 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1203/2403] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:18:40.351391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72589d3037d64037961ad4a8b6613d6e', 'request_id': 'req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:40.371669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:40.378062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72589d3037d64037961ad4a8b6613d6e', 'request_id': 'req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:40.419993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72589d3037d64037961ad4a8b6613d6e', 'request_id': 'req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:40.548299 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] The token cache is being invalidate because project 72589d3037d64037961ad4a8b6613d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:40.548671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:40.549387 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:40.553439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1201/2404] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:40 2022] DELETE /identity/v3/projects/72589d3037d64037961ad4a8b6613d6e => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:40.558623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2e4ed-d773-4dda-9c95-d13f4e4d63b1 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:40.576983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2e4ed-d773-4dda-9c95-d13f4e4d63b1 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:40.673922 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998b823-141b-4209-9ab2-b8be8ff948dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:40.674969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998b823-141b-4209-9ab2-b8be8ff948dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:40.675263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998b823-141b-4209-9ab2-b8be8ff948dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:40.675600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998b823-141b-4209-9ab2-b8be8ff948dd admin admin] PATH_INFO: `/v3/users/3ea9827695494b7b89fb8c6293d388fe` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:40.677134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998b823-141b-4209-9ab2-b8be8ff948dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea9827695494b7b89fb8c6293d388fe)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:40.679635 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998b823-141b-4209-9ab2-b8be8ff948dd admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:40.889462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a998b823-141b-4209-9ab2-b8be8ff948dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea9827695494b7b89fb8c6293d388fe'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:40.910267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a998b823-141b-4209-9ab2-b8be8ff948dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea9827695494b7b89fb8c6293d388fe'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:40.911360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a998b823-141b-4209-9ab2-b8be8ff948dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea9827695494b7b89fb8c6293d388fe'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:40.921328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a998b823-141b-4209-9ab2-b8be8ff948dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea9827695494b7b89fb8c6293d388fe'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:40.922636 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a998b823-141b-4209-9ab2-b8be8ff948dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea9827695494b7b89fb8c6293d388fe'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:41.001175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1204/2405] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:40 2022] DELETE /identity/v3/users/3ea9827695494b7b89fb8c6293d388fe => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:41.767771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:41.770222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:41.798726 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e93c8-1d44-4cda-99da-8bbf8b03cf99 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:41.872594 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:41.874111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:41.874694 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:41.875011 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] PATH_INFO: `/v3/projects/17a0c7f838c549458c8dd0c0d2d07a19` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:41.876566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a0c7f838c549458c8dd0c0d2d07a19)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:41.879175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:41.999924 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a0c7f838c549458c8dd0c0d2d07a19', 'request_id': 'req-f835df3d-d862-4d97-a2ea-752878d4cdb9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:42.009257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a0c7f838c549458c8dd0c0d2d07a19', 'request_id': 'req-f835df3d-d862-4d97-a2ea-752878d4cdb9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:42.021350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a0c7f838c549458c8dd0c0d2d07a19', 'request_id': 'req-f835df3d-d862-4d97-a2ea-752878d4cdb9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:42.049936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd2da-cbbe-42c1-a18b-71dd1433e20f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.050482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd2da-cbbe-42c1-a18b-71dd1433e20f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.050750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dd2da-cbbe-42c1-a18b-71dd1433e20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.104282 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e13dd2da-cbbe-42c1-a18b-71dd1433e20f None None] MFA Rules not processed for user `964af50e111942d091c41431074259fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:42.105627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e13dd2da-cbbe-42c1-a18b-71dd1433e20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:42.135137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:42.142777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] The token cache is being invalidate because project 17a0c7f838c549458c8dd0c0d2d07a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:42.143781 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:42.146129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f835df3d-d862-4d97-a2ea-752878d4cdb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:42.147048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1202/2406] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:41 2022] DELETE /identity/v3/projects/17a0c7f838c549458c8dd0c0d2d07a19 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:42.160443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cffc-b495-404b-ae31-d88cb42a3da7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.160819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cffc-b495-404b-ae31-d88cb42a3da7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.161183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cffc-b495-404b-ae31-d88cb42a3da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.207897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0c03cffc-b495-404b-ae31-d88cb42a3da7 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:42.212034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0c03cffc-b495-404b-ae31-d88cb42a3da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:42.230390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1205/2407] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:42.231556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dd2da-cbbe-42c1-a18b-71dd1433e20f None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:42.233024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e13dd2da-cbbe-42c1-a18b-71dd1433e20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:42.327268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1203/2408] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:42.336090 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328db78b-66bc-4e71-86c8-eacaf06e9cf4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.336381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328db78b-66bc-4e71-86c8-eacaf06e9cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.336664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328db78b-66bc-4e71-86c8-eacaf06e9cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.344604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dd2da-cbbe-42c1-a18b-71dd1433e20f None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:42.366360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92bccb-7e02-4cc4-b2e9-948697b30ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:42.367488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92bccb-7e02-4cc4-b2e9-948697b30ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.368050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92bccb-7e02-4cc4-b2e9-948697b30ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.368283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92bccb-7e02-4cc4-b2e9-948697b30ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.369494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92bccb-7e02-4cc4-b2e9-948697b30ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:42.372063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92bccb-7e02-4cc4-b2e9-948697b30ef0 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:42.373448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-328db78b-66bc-4e71-86c8-eacaf06e9cf4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:42.375682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-328db78b-66bc-4e71-86c8-eacaf06e9cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:42.385250 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1204/2409] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:42.390502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328db78b-66bc-4e71-86c8-eacaf06e9cf4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:42.401841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328db78b-66bc-4e71-86c8-eacaf06e9cf4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:42.407504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d985d-9ebc-48f0-ae14-f91549af430c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:42.410948 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d985d-9ebc-48f0-ae14-f91549af430c admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.410948 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d985d-9ebc-48f0-ae14-f91549af430c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.410948 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d985d-9ebc-48f0-ae14-f91549af430c admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.410948 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d985d-9ebc-48f0-ae14-f91549af430c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:18:42.410948 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d985d-9ebc-48f0-ae14-f91549af430c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:42.411501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d985d-9ebc-48f0-ae14-f91549af430c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:42.414805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:42.424679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1205/2410] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:18:42.429288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d985d-9ebc-48f0-ae14-f91549af430c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:42.441123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d985d-9ebc-48f0-ae14-f91549af430c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:42.446075 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ec921-3cc7-4ae4-b7d5-32b302380e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:42.446755 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ec921-3cc7-4ae4-b7d5-32b302380e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.447006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ec921-3cc7-4ae4-b7d5-32b302380e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.447346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ec921-3cc7-4ae4-b7d5-32b302380e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.448082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ec921-3cc7-4ae4-b7d5-32b302380e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:42.450065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ec921-3cc7-4ae4-b7d5-32b302380e70 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:42.513149 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1206/2411] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:42 2022] POST /identity/v3/projects => generated 403 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:42.514128 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92bccb-7e02-4cc4-b2e9-948697b30ef0 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:42.582431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1206/2412] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:42 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:18:42.587644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ec921-3cc7-4ae4-b7d5-32b302380e70 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:42.615711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92bccb-7e02-4cc4-b2e9-948697b30ef0 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:42.661631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ec921-3cc7-4ae4-b7d5-32b302380e70 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:42.666443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106fbec-3178-44fb-bab7-2e8f17a911a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:42.667229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106fbec-3178-44fb-bab7-2e8f17a911a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.667634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106fbec-3178-44fb-bab7-2e8f17a911a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.668026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106fbec-3178-44fb-bab7-2e8f17a911a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.669416 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106fbec-3178-44fb-bab7-2e8f17a911a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:42.671742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106fbec-3178-44fb-bab7-2e8f17a911a6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:42.737425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848a422-69e6-4da9-b36a-eb2b94301635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:42.738528 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848a422-69e6-4da9-b36a-eb2b94301635 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.738982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848a422-69e6-4da9-b36a-eb2b94301635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.739260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848a422-69e6-4da9-b36a-eb2b94301635 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.740009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848a422-69e6-4da9-b36a-eb2b94301635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:42.741998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848a422-69e6-4da9-b36a-eb2b94301635 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:42.759980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1207/2413] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:42 2022] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:42.768302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106fbec-3178-44fb-bab7-2e8f17a911a6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:42.783628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106fbec-3178-44fb-bab7-2e8f17a911a6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:42.788967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350797e-5c94-43ee-b7d1-7eade0b28ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:42.789732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350797e-5c94-43ee-b7d1-7eade0b28ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.790087 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350797e-5c94-43ee-b7d1-7eade0b28ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.790447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350797e-5c94-43ee-b7d1-7eade0b28ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.791313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350797e-5c94-43ee-b7d1-7eade0b28ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:42.793350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350797e-5c94-43ee-b7d1-7eade0b28ad0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:42.810347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1208/2414] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:42.813864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350797e-5c94-43ee-b7d1-7eade0b28ad0 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:42.829814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350797e-5c94-43ee-b7d1-7eade0b28ad0 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:42.839692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1207/2415] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:42 2022] POST /identity/v3/users => generated 308 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:42.843062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bb6f5-7378-4ea1-8b51-45d15cc841bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:42.845437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:42.850751 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848a422-69e6-4da9-b36a-eb2b94301635 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:42.856836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb6f5-7378-4ea1-8b51-45d15cc841bd admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.857132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb6f5-7378-4ea1-8b51-45d15cc841bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.857416 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb6f5-7378-4ea1-8b51-45d15cc841bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.859974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bb6f5-7378-4ea1-8b51-45d15cc841bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:42.861644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bb6f5-7378-4ea1-8b51-45d15cc841bd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:42.870729 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848a422-69e6-4da9-b36a-eb2b94301635 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:42.879417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1917e3-0f55-452d-81c4-cb044064d986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:42.880140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1917e3-0f55-452d-81c4-cb044064d986 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.880426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1917e3-0f55-452d-81c4-cb044064d986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.880703 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1917e3-0f55-452d-81c4-cb044064d986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.895507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1917e3-0f55-452d-81c4-cb044064d986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:42.900769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1917e3-0f55-452d-81c4-cb044064d986 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:42.907546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1209/2416] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:42.909320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bb6f5-7378-4ea1-8b51-45d15cc841bd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:42.933363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bb6f5-7378-4ea1-8b51-45d15cc841bd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:42.934708 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1208/2417] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:42.938782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1917e3-0f55-452d-81c4-cb044064d986 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:42.950284 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dd627-4a10-47fe-85db-d62b8ba5646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:42.951558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dd627-4a10-47fe-85db-d62b8ba5646b admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.951985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dd627-4a10-47fe-85db-d62b8ba5646b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.952270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dd627-4a10-47fe-85db-d62b8ba5646b admin admin] PATH_INFO: `/v3/projects/a996dc2d1f314f129a32e07d996700b1/users/141ba7c1d3ff45e3abd561464da8fa3c/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.955729 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1917e3-0f55-452d-81c4-cb044064d986 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:42.974634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab185f39-3bae-4a45-87e7-9a090466ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:42.976384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab185f39-3bae-4a45-87e7-9a090466ee85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:42.976384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab185f39-3bae-4a45-87e7-9a090466ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:42.976384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab185f39-3bae-4a45-87e7-9a090466ee85 admin admin] PATH_INFO: `/v3/projects/fa8f43a1de0a42b7928bb102203c1147/users/02a232d2c2b64766a1fa913f968af3ce/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:42.990270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dd627-4a10-47fe-85db-d62b8ba5646b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a996dc2d1f314f129a32e07d996700b1, user_id=141ba7c1d3ff45e3abd561464da8fa3c, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:43.008953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dd627-4a10-47fe-85db-d62b8ba5646b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:43.022628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab185f39-3bae-4a45-87e7-9a090466ee85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8f43a1de0a42b7928bb102203c1147, user_id=02a232d2c2b64766a1fa913f968af3ce, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:43.029416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab185f39-3bae-4a45-87e7-9a090466ee85 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:43.136434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1210/2418] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:42 2022] PUT /identity/v3/projects/a996dc2d1f314f129a32e07d996700b1/users/141ba7c1d3ff45e3abd561464da8fa3c/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:43.138112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1209/2419] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:42 2022] PUT /identity/v3/projects/fa8f43a1de0a42b7928bb102203c1147/users/02a232d2c2b64766a1fa913f968af3ce/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:18:43.139880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968578-6f5e-4376-8883-ec05f972cd49 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:43.140190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968578-6f5e-4376-8883-ec05f972cd49 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:43.140470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968578-6f5e-4376-8883-ec05f972cd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:43.142657 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab185f39-3bae-4a45-87e7-9a090466ee85 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:43.195439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c0968578-6f5e-4376-8883-ec05f972cd49 None None] MFA Rules not processed for user `141ba7c1d3ff45e3abd561464da8fa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:43.197364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c0968578-6f5e-4376-8883-ec05f972cd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:43.257800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab185f39-3bae-4a45-87e7-9a090466ee85 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:43.308301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1211/2420] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:43.313640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0968578-6f5e-4376-8883-ec05f972cd49 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:43.326278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc028f03-9291-4070-9e17-4f79727fa661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:43.327064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028f03-9291-4070-9e17-4f79727fa661 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:43.327423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028f03-9291-4070-9e17-4f79727fa661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:43.327803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc028f03-9291-4070-9e17-4f79727fa661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:43.328674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc028f03-9291-4070-9e17-4f79727fa661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:43.330383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc028f03-9291-4070-9e17-4f79727fa661 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:43.342662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1210/2421] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:43.342878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:43.346782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc028f03-9291-4070-9e17-4f79727fa661 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:43.369980 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc028f03-9291-4070-9e17-4f79727fa661 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:43.382218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c5406-cf78-40ae-b437-1d11b5ed1a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:43.383155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5406-cf78-40ae-b437-1d11b5ed1a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:43.383415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5406-cf78-40ae-b437-1d11b5ed1a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:43.388134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5406-cf78-40ae-b437-1d11b5ed1a8b admin admin] PATH_INFO: `/v3/projects/fa8f43a1de0a42b7928bb102203c1147/users/02a232d2c2b64766a1fa913f968af3ce/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:43.388134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c5406-cf78-40ae-b437-1d11b5ed1a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa8f43a1de0a42b7928bb102203c1147, user_id=02a232d2c2b64766a1fa913f968af3ce, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:43.389499 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c5406-cf78-40ae-b437-1d11b5ed1a8b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:43.416861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0968578-6f5e-4376-8883-ec05f972cd49 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:43.417108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1211/2422] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:43 2022] PUT /identity/v3/projects/fa8f43a1de0a42b7928bb102203c1147/users/02a232d2c2b64766a1fa913f968af3ce/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:43.524684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f068282-59fe-4e25-8ec6-9daf508f9725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:43.525673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f068282-59fe-4e25-8ec6-9daf508f9725 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:43.525989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f068282-59fe-4e25-8ec6-9daf508f9725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:43.526661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f068282-59fe-4e25-8ec6-9daf508f9725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:43.527479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f068282-59fe-4e25-8ec6-9daf508f9725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:43.531294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f068282-59fe-4e25-8ec6-9daf508f9725 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:43.671130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1212/2423] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:43 2022] POST /identity/v3/projects => generated 389 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:18:43.675312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c5406-cf78-40ae-b437-1d11b5ed1a8b admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:43.688853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c5406-cf78-40ae-b437-1d11b5ed1a8b admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:43.758141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:43.779747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dd7db-64ac-4698-9652-77bddddff317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:43.780534 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dd7db-64ac-4698-9652-77bddddff317 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:43.780886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dd7db-64ac-4698-9652-77bddddff317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:43.781202 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dd7db-64ac-4698-9652-77bddddff317 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:43.781895 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dd7db-64ac-4698-9652-77bddddff317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:43.783966 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dd7db-64ac-4698-9652-77bddddff317 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:43.876422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1212/2424] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:43 2022] POST /identity/v3/users => generated 301 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:43.881415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f068282-59fe-4e25-8ec6-9daf508f9725 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:43.898005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f068282-59fe-4e25-8ec6-9daf508f9725 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:43.902633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad48dec-8fae-4791-8834-f5704e2e04a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:43.903991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad48dec-8fae-4791-8834-f5704e2e04a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:43.904546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad48dec-8fae-4791-8834-f5704e2e04a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:43.904857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad48dec-8fae-4791-8834-f5704e2e04a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:43.905604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad48dec-8fae-4791-8834-f5704e2e04a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:43.907226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad48dec-8fae-4791-8834-f5704e2e04a1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:43.927464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1213/2425] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:43.927675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dd7db-64ac-4698-9652-77bddddff317 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:43.936361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dd7db-64ac-4698-9652-77bddddff317 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:43.941683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213b4b-3b7f-4864-9ed0-c71113644950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:43.942943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213b4b-3b7f-4864-9ed0-c71113644950 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:43.944012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213b4b-3b7f-4864-9ed0-c71113644950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:43.944372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc213b4b-3b7f-4864-9ed0-c71113644950 admin admin] PATH_INFO: `/v3/projects/568045596b2c4666b3bf92e71d049720/users/27de6e6c18f44aa4a24eda58d3b3ca6d/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:43.964300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc213b4b-3b7f-4864-9ed0-c71113644950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=568045596b2c4666b3bf92e71d049720, user_id=27de6e6c18f44aa4a24eda58d3b3ca6d, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:43.967356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc213b4b-3b7f-4864-9ed0-c71113644950 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:44.061932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1213/2426] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:43 2022] PUT /identity/v3/projects/568045596b2c4666b3bf92e71d049720/users/27de6e6c18f44aa4a24eda58d3b3ca6d/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:44.066149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad48dec-8fae-4791-8834-f5704e2e04a1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:44.076797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad48dec-8fae-4791-8834-f5704e2e04a1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:44.216173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6b8e7-db48-418f-ac12-05eca5b07404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:44.217198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6b8e7-db48-418f-ac12-05eca5b07404 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:44.217638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6b8e7-db48-418f-ac12-05eca5b07404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:44.218116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6b8e7-db48-418f-ac12-05eca5b07404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:44.222987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6b8e7-db48-418f-ac12-05eca5b07404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:44.228905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6b8e7-db48-418f-ac12-05eca5b07404 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:44.251693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1214/2427] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:18:44.261799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213b4b-3b7f-4864-9ed0-c71113644950 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:44.277493 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc213b4b-3b7f-4864-9ed0-c71113644950 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:44.296580 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e11f2-e229-48c2-b463-37c6eacd68f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:44.298009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e11f2-e229-48c2-b463-37c6eacd68f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:44.298366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e11f2-e229-48c2-b463-37c6eacd68f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:44.298660 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e11f2-e229-48c2-b463-37c6eacd68f2 admin admin] PATH_INFO: `/v3/projects/568045596b2c4666b3bf92e71d049720/users/27de6e6c18f44aa4a24eda58d3b3ca6d/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:44.303875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e11f2-e229-48c2-b463-37c6eacd68f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=568045596b2c4666b3bf92e71d049720, user_id=27de6e6c18f44aa4a24eda58d3b3ca6d, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:44.315886 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e11f2-e229-48c2-b463-37c6eacd68f2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:44.358839 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1214/2428] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:44 2022] PUT /identity/v3/projects/568045596b2c4666b3bf92e71d049720/users/27de6e6c18f44aa4a24eda58d3b3ca6d/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:44.359030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7390ee-86ad-46a8-8994-ee309a053199 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:44.359284 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7390ee-86ad-46a8-8994-ee309a053199 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:44.359613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7390ee-86ad-46a8-8994-ee309a053199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:44.420893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7e7390ee-86ad-46a8-8994-ee309a053199 None None] MFA Rules not processed for user `27de6e6c18f44aa4a24eda58d3b3ca6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:44.420893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7e7390ee-86ad-46a8-8994-ee309a053199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:44.445972 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:44.574543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1215/2429] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:44.575679 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e11f2-e229-48c2-b463-37c6eacd68f2 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:44.576989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-288e11f2-e229-48c2-b463-37c6eacd68f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:44.651463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e11f2-e229-48c2-b463-37c6eacd68f2 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:44.656407 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa4321-9af3-46f2-9efd-0e567202d95e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:44.657074 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4321-9af3-46f2-9efd-0e567202d95e service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:44.657364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4321-9af3-46f2-9efd-0e567202d95e service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:44.657676 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4321-9af3-46f2-9efd-0e567202d95e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:44.671846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa4321-9af3-46f2-9efd-0e567202d95e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:44.673479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa4321-9af3-46f2-9efd-0e567202d95e service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:44.683977 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1215/2430] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:44.828149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7390ee-86ad-46a8-8994-ee309a053199 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:44.908986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7390ee-86ad-46a8-8994-ee309a053199 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:44.914070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:44.915229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:44.915641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:44.916024 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] PATH_INFO: `/v3/users/141ba7c1d3ff45e3abd561464da8fa3c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:44.917359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=141ba7c1d3ff45e3abd561464da8fa3c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:44.919864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:45.241898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141ba7c1d3ff45e3abd561464da8fa3c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:45.284894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141ba7c1d3ff45e3abd561464da8fa3c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:45.298188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141ba7c1d3ff45e3abd561464da8fa3c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:45.298903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141ba7c1d3ff45e3abd561464da8fa3c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:45.299508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141ba7c1d3ff45e3abd561464da8fa3c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:45.312222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1216/2431] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:44 2022] DELETE /identity/v3/users/141ba7c1d3ff45e3abd561464da8fa3c => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:45.317013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec455bbc-4321-4b82-890f-2fa11d4e84ff None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:45.317813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec455bbc-4321-4b82-890f-2fa11d4e84ff None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:45.317813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec455bbc-4321-4b82-890f-2fa11d4e84ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:45.336204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-ec455bbc-4321-4b82-890f-2fa11d4e84ff None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:45.337422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ec455bbc-4321-4b82-890f-2fa11d4e84ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:45.470459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1216/2432] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:45.492514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:45.494640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:45.571111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:45.577923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfec5c2-bb76-4ff2-abc3-d03ccd0082dd None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:45.585761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfec5c2-bb76-4ff2-abc3-d03ccd0082dd None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:45.585761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfec5c2-bb76-4ff2-abc3-d03ccd0082dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:45.641863 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-8dfec5c2-bb76-4ff2-abc3-d03ccd0082dd None None] MFA Rules not processed for user `02a232d2c2b64766a1fa913f968af3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:45.645687 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8dfec5c2-bb76-4ff2-abc3-d03ccd0082dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:45.646952 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c48104-406f-46b7-829d-0bf603d60c78 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:45.656679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3b4a2-c250-4eb9-b240-ed4fff920b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:45.657301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3b4a2-c250-4eb9-b240-ed4fff920b0f service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:45.658820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3b4a2-c250-4eb9-b240-ed4fff920b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:45.659330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3b4a2-c250-4eb9-b240-ed4fff920b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:45.680034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3b4a2-c250-4eb9-b240-ed4fff920b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:45.685322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3b4a2-c250-4eb9-b240-ed4fff920b0f service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:45.692453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:45.699156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1217/2433] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:45.758889 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1217/2434] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:46.390305 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3b4a2-c250-4eb9-b240-ed4fff920b0f service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:46.392405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cfd3b4a2-c250-4eb9-b240-ed4fff920b0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:46.406610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3b4a2-c250-4eb9-b240-ed4fff920b0f service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:46.411833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:46.412820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:46.413131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:46.413381 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] PATH_INFO: `/v3/projects/a996dc2d1f314f129a32e07d996700b1` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:46.414600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a996dc2d1f314f129a32e07d996700b1)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:46.416636 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:46.544889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a996dc2d1f314f129a32e07d996700b1', 'request_id': 'req-30316816-96ce-4274-851e-2251c974a781'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:46.555448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a996dc2d1f314f129a32e07d996700b1', 'request_id': 'req-30316816-96ce-4274-851e-2251c974a781'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:46.567022 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a996dc2d1f314f129a32e07d996700b1', 'request_id': 'req-30316816-96ce-4274-851e-2251c974a781'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:46.684816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] The token cache is being invalidate because project a996dc2d1f314f129a32e07d996700b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:46.685228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:46.686040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:46.687758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1218/2435] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:46 2022] DELETE /identity/v3/projects/a996dc2d1f314f129a32e07d996700b1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:46.691942 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfec5c2-bb76-4ff2-abc3-d03ccd0082dd None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:46.705274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfec5c2-bb76-4ff2-abc3-d03ccd0082dd None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:46.809884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:46.809884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:46.809884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:46.809884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] PATH_INFO: `/v3/users/27de6e6c18f44aa4a24eda58d3b3ca6d` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:46.811317 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27de6e6c18f44aa4a24eda58d3b3ca6d)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:46.813632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:47.035232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27de6e6c18f44aa4a24eda58d3b3ca6d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:47.064839 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27de6e6c18f44aa4a24eda58d3b3ca6d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:47.071077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27de6e6c18f44aa4a24eda58d3b3ca6d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:47.077003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27de6e6c18f44aa4a24eda58d3b3ca6d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:47.082188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27de6e6c18f44aa4a24eda58d3b3ca6d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:47.182052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1218/2436] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:46 2022] DELETE /identity/v3/users/27de6e6c18f44aa4a24eda58d3b3ca6d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:47.571897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:47.573552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:47.590831 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30316816-96ce-4274-851e-2251c974a781 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:47.660121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a7b2-b453-4699-86b6-4be3d4c8378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:47.661249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a7b2-b453-4699-86b6-4be3d4c8378b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:47.661724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a7b2-b453-4699-86b6-4be3d4c8378b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:47.662111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a7b2-b453-4699-86b6-4be3d4c8378b admin admin] PATH_INFO: `/v3/users/964af50e111942d091c41431074259fb` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:47.663446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a7b2-b453-4699-86b6-4be3d4c8378b admin admin] RBAC: Authorizing `identity:delete_user(user_id=964af50e111942d091c41431074259fb)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:47.665578 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a7b2-b453-4699-86b6-4be3d4c8378b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:47.710281 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:47.712219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:47.727013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf633e-db21-4d6c-8292-65fc0800707e admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:47.745549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:47.746498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:47.747308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:47.747831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] PATH_INFO: `/v3/projects/568045596b2c4666b3bf92e71d049720` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:47.750203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] RBAC: Authorizing `identity:delete_project(project_id=568045596b2c4666b3bf92e71d049720)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:47.755337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:47.847297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5490a7b2-b453-4699-86b6-4be3d4c8378b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964af50e111942d091c41431074259fb'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:47.874635 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:47.892796 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568045596b2c4666b3bf92e71d049720', 'request_id': 'req-87d98e8c-464c-422a-9a9b-7e4332bb725c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:47.918135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5490a7b2-b453-4699-86b6-4be3d4c8378b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964af50e111942d091c41431074259fb'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:47.920859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:47.932272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5490a7b2-b453-4699-86b6-4be3d4c8378b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964af50e111942d091c41431074259fb'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:47.933182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5490a7b2-b453-4699-86b6-4be3d4c8378b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964af50e111942d091c41431074259fb'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:47.933856 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5490a7b2-b453-4699-86b6-4be3d4c8378b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964af50e111942d091c41431074259fb'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:47.948593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1219/2437] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:47 2022] DELETE /identity/v3/users/964af50e111942d091c41431074259fb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:48.005346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568045596b2c4666b3bf92e71d049720', 'request_id': 'req-87d98e8c-464c-422a-9a9b-7e4332bb725c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:48.013723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568045596b2c4666b3bf92e71d049720', 'request_id': 'req-87d98e8c-464c-422a-9a9b-7e4332bb725c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:48.026998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] The token cache is being invalidate because project 568045596b2c4666b3bf92e71d049720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:48.027437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:48.028757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-87d98e8c-464c-422a-9a9b-7e4332bb725c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:48.032883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1219/2438] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:47 2022] DELETE /identity/v3/projects/568045596b2c4666b3bf92e71d049720 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:48.035990 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4120e4f-7613-4ba6-b11a-7d19e9aae5e5 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:48.036400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4120e4f-7613-4ba6-b11a-7d19e9aae5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:48.036780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4120e4f-7613-4ba6-b11a-7d19e9aae5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:48.078959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b4120e4f-7613-4ba6-b11a-7d19e9aae5e5 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:48.080313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b4120e4f-7613-4ba6-b11a-7d19e9aae5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:48.177748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1220/2439] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:48.185356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa31e7-4d90-426b-ade4-ca7b3179b4e1 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:48.185578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa31e7-4d90-426b-ade4-ca7b3179b4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:48.187818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa31e7-4d90-426b-ade4-ca7b3179b4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:48.206010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-69fa31e7-4d90-426b-ade4-ca7b3179b4e1 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:48.208001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-69fa31e7-4d90-426b-ade4-ca7b3179b4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:48.216759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1220/2440] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:48.223144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4120e4f-7613-4ba6-b11a-7d19e9aae5e5 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:48.236882 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4120e4f-7613-4ba6-b11a-7d19e9aae5e5 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:48.238983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c269ebc-eea8-4c1b-b51d-052c78b5775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:48.239786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c269ebc-eea8-4c1b-b51d-052c78b5775b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:48.240117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c269ebc-eea8-4c1b-b51d-052c78b5775b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:48.240407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c269ebc-eea8-4c1b-b51d-052c78b5775b admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:48.241232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c269ebc-eea8-4c1b-b51d-052c78b5775b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:18:48.241550 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c269ebc-eea8-4c1b-b51d-052c78b5775b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:48.243431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c269ebc-eea8-4c1b-b51d-052c78b5775b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:48.269409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1221/2441] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:18:48.273517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa31e7-4d90-426b-ade4-ca7b3179b4e1 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:48.296740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa31e7-4d90-426b-ade4-ca7b3179b4e1 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:48.305969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939219a-5313-4dab-b302-842e7dfa3000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:48.306923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939219a-5313-4dab-b302-842e7dfa3000 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:48.315738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939219a-5313-4dab-b302-842e7dfa3000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:48.318990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939219a-5313-4dab-b302-842e7dfa3000 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:48.321619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939219a-5313-4dab-b302-842e7dfa3000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:48.327319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939219a-5313-4dab-b302-842e7dfa3000 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:48.334427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c269ebc-eea8-4c1b-b51d-052c78b5775b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:48.334427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7c269ebc-eea8-4c1b-b51d-052c78b5775b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:48.362201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c269ebc-eea8-4c1b-b51d-052c78b5775b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:48.374237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:48.375302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:48.375677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:48.384360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] PATH_INFO: `/v3/projects/47939607ad23427594aca1c660a0aa5d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:48.384360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47939607ad23427594aca1c660a0aa5d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:48.384360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:48.458707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1221/2442] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:48 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:18:48.463192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939219a-5313-4dab-b302-842e7dfa3000 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:48.537635 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939219a-5313-4dab-b302-842e7dfa3000 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:48.550855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47939607ad23427594aca1c660a0aa5d', 'request_id': 'req-b901531b-dc29-4d0b-9774-be4520f40425'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:48.560592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47939607ad23427594aca1c660a0aa5d', 'request_id': 'req-b901531b-dc29-4d0b-9774-be4520f40425'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:48.568524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47939607ad23427594aca1c660a0aa5d', 'request_id': 'req-b901531b-dc29-4d0b-9774-be4520f40425'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:48.602257 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b71c70-7cfd-4cd4-8c67-480801b09189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:48.606787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b71c70-7cfd-4cd4-8c67-480801b09189 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:48.606787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b71c70-7cfd-4cd4-8c67-480801b09189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:48.606787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b71c70-7cfd-4cd4-8c67-480801b09189 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:48.606787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b71c70-7cfd-4cd4-8c67-480801b09189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:48.606787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b71c70-7cfd-4cd4-8c67-480801b09189 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:48.723117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] The token cache is being invalidate because project 47939607ad23427594aca1c660a0aa5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:48.723527 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:48.724080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:48.731169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1222/2443] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:48 2022] POST /identity/v3/users => generated 284 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:48.731828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1222/2444] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:48 2022] DELETE /identity/v3/projects/47939607ad23427594aca1c660a0aa5d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:18:48.731933 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b71c70-7cfd-4cd4-8c67-480801b09189 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:48.731933 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a1b71c70-7cfd-4cd4-8c67-480801b09189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:48.734702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:48.736328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:48.743767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b71c70-7cfd-4cd4-8c67-480801b09189 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:48.749312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd770592-2339-4e73-98b9-0587380f4812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:48.749979 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770592-2339-4e73-98b9-0587380f4812 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:48.750093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901531b-dc29-4d0b-9774-be4520f40425 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:48.750425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770592-2339-4e73-98b9-0587380f4812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:48.750778 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770592-2339-4e73-98b9-0587380f4812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:48.751544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd770592-2339-4e73-98b9-0587380f4812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:48.753177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd770592-2339-4e73-98b9-0587380f4812 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:48.754724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:48.755604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:48.755938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:48.756220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] PATH_INFO: `/v3/users/02a232d2c2b64766a1fa913f968af3ce` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:48.757421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a232d2c2b64766a1fa913f968af3ce)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:48.759325 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:48.765148 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1223/2445] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:18:48.769462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd770592-2339-4e73-98b9-0587380f4812 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:48.779412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd770592-2339-4e73-98b9-0587380f4812 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:48.784365 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a37af8-69a6-4b4f-b89d-810fbdaa6aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:48.785029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a37af8-69a6-4b4f-b89d-810fbdaa6aed admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:48.785316 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a37af8-69a6-4b4f-b89d-810fbdaa6aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:48.785598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a37af8-69a6-4b4f-b89d-810fbdaa6aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:48.786352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a37af8-69a6-4b4f-b89d-810fbdaa6aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:48.788009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a37af8-69a6-4b4f-b89d-810fbdaa6aed admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:48.802831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1224/2446] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:48.807070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a37af8-69a6-4b4f-b89d-810fbdaa6aed admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:48.817177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a37af8-69a6-4b4f-b89d-810fbdaa6aed admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:48.821973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6376ad-6a37-4bff-8377-9c949734cdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:48.826975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6376ad-6a37-4bff-8377-9c949734cdac admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:48.826975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6376ad-6a37-4bff-8377-9c949734cdac admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:48.826975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6376ad-6a37-4bff-8377-9c949734cdac admin admin] PATH_INFO: `/v3/projects/426383f03e934c0da352e1fac9576778/users/4140f62cd1ca40f89e2eaa339092c665/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:48.832628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:48.839832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6376ad-6a37-4bff-8377-9c949734cdac admin admin] RBAC: Authorizing `identity:create_grant(project_id=426383f03e934c0da352e1fac9576778, user_id=4140f62cd1ca40f89e2eaa339092c665, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:48.843453 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6376ad-6a37-4bff-8377-9c949734cdac admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:48.925207 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1225/2447] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:48 2022] PUT /identity/v3/projects/426383f03e934c0da352e1fac9576778/users/4140f62cd1ca40f89e2eaa339092c665/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:18:48.926928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:48.932852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a232d2c2b64766a1fa913f968af3ce'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:48.936501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3728cf-f6c1-4011-a129-5a07fb833cc1 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:48.936789 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3728cf-f6c1-4011-a129-5a07fb833cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:48.937067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3728cf-f6c1-4011-a129-5a07fb833cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:48.964225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-cc3728cf-f6c1-4011-a129-5a07fb833cc1 None None] MFA Rules not processed for user `4140f62cd1ca40f89e2eaa339092c665`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:48.966030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-cc3728cf-f6c1-4011-a129-5a07fb833cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:49.029196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1226/2448] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:49.033506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3728cf-f6c1-4011-a129-5a07fb833cc1 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:49.043391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a232d2c2b64766a1fa913f968af3ce'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:49.056370 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a232d2c2b64766a1fa913f968af3ce'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:49.057046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a232d2c2b64766a1fa913f968af3ce'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:49.057674 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a232d2c2b64766a1fa913f968af3ce'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:49.070391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1223/2449] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:48 2022] DELETE /identity/v3/users/02a232d2c2b64766a1fa913f968af3ce => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:49.097143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3728cf-f6c1-4011-a129-5a07fb833cc1 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:49.158613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904cf2d-1904-4122-bd48-11de81fafd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:49.159474 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904cf2d-1904-4122-bd48-11de81fafd8f admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.160175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904cf2d-1904-4122-bd48-11de81fafd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.160175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904cf2d-1904-4122-bd48-11de81fafd8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.160516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904cf2d-1904-4122-bd48-11de81fafd8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:49.171898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904cf2d-1904-4122-bd48-11de81fafd8f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:49.282835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1227/2450] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:49 2022] POST /identity/v3/projects => generated 367 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:18:49.284776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:49.286238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:49.299227 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904cf2d-1904-4122-bd48-11de81fafd8f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:49.300780 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70932be-16c0-4810-87ed-9185cce20374 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:49.301096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e904cf2d-1904-4122-bd48-11de81fafd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:49.314811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:49.367118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa546dc8-6e2b-419b-a771-29db4d187ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:49.367863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa546dc8-6e2b-419b-a771-29db4d187ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.368149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa546dc8-6e2b-419b-a771-29db4d187ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.368988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa546dc8-6e2b-419b-a771-29db4d187ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.369470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa546dc8-6e2b-419b-a771-29db4d187ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:49.371377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa546dc8-6e2b-419b-a771-29db4d187ba0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:49.373280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904cf2d-1904-4122-bd48-11de81fafd8f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:49.378274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:49.379266 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.379552 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.380218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] PATH_INFO: `/v3/projects/fa8f43a1de0a42b7928bb102203c1147` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.381625 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa8f43a1de0a42b7928bb102203c1147)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:49.383618 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:49.481631 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1224/2451] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:49 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:49.485620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa546dc8-6e2b-419b-a771-29db4d187ba0 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:49.497852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa546dc8-6e2b-419b-a771-29db4d187ba0 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:49.498189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa8f43a1de0a42b7928bb102203c1147', 'request_id': 'req-4aa884fe-aff9-4551-bee4-da6dc161940b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:49.565418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bccbcf-2f71-4bda-8bec-45d324b93097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:49.566106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bccbcf-2f71-4bda-8bec-45d324b93097 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.566395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bccbcf-2f71-4bda-8bec-45d324b93097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.566706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bccbcf-2f71-4bda-8bec-45d324b93097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.567453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bccbcf-2f71-4bda-8bec-45d324b93097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:49.569223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bccbcf-2f71-4bda-8bec-45d324b93097 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:49.580623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1225/2452] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:49.584312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bccbcf-2f71-4bda-8bec-45d324b93097 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:49.593642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa8f43a1de0a42b7928bb102203c1147', 'request_id': 'req-4aa884fe-aff9-4551-bee4-da6dc161940b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:49.595446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bccbcf-2f71-4bda-8bec-45d324b93097 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:49.600790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ff6b8-93b3-4f0a-8d20-d09e4408b323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:49.600958 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa8f43a1de0a42b7928bb102203c1147', 'request_id': 'req-4aa884fe-aff9-4551-bee4-da6dc161940b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:49.602345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ff6b8-93b3-4f0a-8d20-d09e4408b323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.602345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ff6b8-93b3-4f0a-8d20-d09e4408b323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.602345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ff6b8-93b3-4f0a-8d20-d09e4408b323 admin admin] PATH_INFO: `/v3/projects/7e17f3e3a8cf43a399341e114e4b26b0/users/9814d055b4344eb09a5a1c0ce8c04e4e/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.618788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] The token cache is being invalidate because project fa8f43a1de0a42b7928bb102203c1147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:49.618926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ff6b8-93b3-4f0a-8d20-d09e4408b323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e17f3e3a8cf43a399341e114e4b26b0, user_id=9814d055b4344eb09a5a1c0ce8c04e4e, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:49.619280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:49.620506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4aa884fe-aff9-4551-bee4-da6dc161940b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:49.622041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1228/2453] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:49 2022] DELETE /identity/v3/projects/fa8f43a1de0a42b7928bb102203c1147 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:49.625160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ff6b8-93b3-4f0a-8d20-d09e4408b323 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:49.629260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ae9f5-5f1f-4309-bcd5-54bcd2319d8f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.629659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ae9f5-5f1f-4309-bcd5-54bcd2319d8f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.630008 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ae9f5-5f1f-4309-bcd5-54bcd2319d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.649574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a33ae9f5-5f1f-4309-bcd5-54bcd2319d8f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:49.650784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a33ae9f5-5f1f-4309-bcd5-54bcd2319d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:49.659028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1229/2454] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:49.668055 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec1b2-58d8-4990-b342-f0293db09d86 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.668349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec1b2-58d8-4990-b342-f0293db09d86 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.669140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec1b2-58d8-4990-b342-f0293db09d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.687602 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-aa8ec1b2-58d8-4990-b342-f0293db09d86 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:49.688961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-aa8ec1b2-58d8-4990-b342-f0293db09d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:49.696950 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1230/2455] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:49.701133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ec1b2-58d8-4990-b342-f0293db09d86 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:49.705557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1226/2456] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:49 2022] PUT /identity/v3/projects/7e17f3e3a8cf43a399341e114e4b26b0/users/9814d055b4344eb09a5a1c0ce8c04e4e/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:18:49.708056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ff6b8-93b3-4f0a-8d20-d09e4408b323 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:49.709791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d37ff6b8-93b3-4f0a-8d20-d09e4408b323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:49.710569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ec1b2-58d8-4990-b342-f0293db09d86 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:49.729873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:49.768322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54af278-7806-40c4-8a96-beefa8ece7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:49.769025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54af278-7806-40c4-8a96-beefa8ece7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.769314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54af278-7806-40c4-8a96-beefa8ece7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.769593 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54af278-7806-40c4-8a96-beefa8ece7e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.770322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54af278-7806-40c4-8a96-beefa8ece7e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:18:49.770630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54af278-7806-40c4-8a96-beefa8ece7e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:49.772269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54af278-7806-40c4-8a96-beefa8ece7e0 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:49.777677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ff6b8-93b3-4f0a-8d20-d09e4408b323 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:49.782643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daf565-349c-4c05-96e3-dcbd2433196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:49.783306 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daf565-349c-4c05-96e3-dcbd2433196c admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.783617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daf565-349c-4c05-96e3-dcbd2433196c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.784158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98daf565-349c-4c05-96e3-dcbd2433196c admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.784298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1231/2457] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:18:49.784642 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98daf565-349c-4c05-96e3-dcbd2433196c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:49.786356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98daf565-349c-4c05-96e3-dcbd2433196c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:49.788566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54af278-7806-40c4-8a96-beefa8ece7e0 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:49.797816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1227/2458] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:18:49.801967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daf565-349c-4c05-96e3-dcbd2433196c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:49.804277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54af278-7806-40c4-8a96-beefa8ece7e0 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:49.809675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c0f17-86c7-4228-b446-96d74d03eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:49.810369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c0f17-86c7-4228-b446-96d74d03eef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.810656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c0f17-86c7-4228-b446-96d74d03eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.810935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c0f17-86c7-4228-b446-96d74d03eef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.811641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c0f17-86c7-4228-b446-96d74d03eef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:49.812945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98daf565-349c-4c05-96e3-dcbd2433196c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:49.813545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c0f17-86c7-4228-b446-96d74d03eef5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:49.817906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f2815-cb00-421d-ad31-5e08d0841fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:49.818778 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2815-cb00-421d-ad31-5e08d0841fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.819062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2815-cb00-421d-ad31-5e08d0841fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.819349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f2815-cb00-421d-ad31-5e08d0841fc2 admin admin] PATH_INFO: `/v3/projects/7e17f3e3a8cf43a399341e114e4b26b0/users/9814d055b4344eb09a5a1c0ce8c04e4e/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.821434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2815-cb00-421d-ad31-5e08d0841fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e17f3e3a8cf43a399341e114e4b26b0, user_id=9814d055b4344eb09a5a1c0ce8c04e4e, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:49.825280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f2815-cb00-421d-ad31-5e08d0841fc2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:49.835266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1228/2459] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:49 2022] PUT /identity/v3/projects/7e17f3e3a8cf43a399341e114e4b26b0/users/9814d055b4344eb09a5a1c0ce8c04e4e/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:18:49.902154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3171d-83c7-45b4-81b9-3fce7af24967 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:49.902490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3171d-83c7-45b4-81b9-3fce7af24967 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:49.902742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3171d-83c7-45b4-81b9-3fce7af24967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:49.931798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-76c3171d-83c7-45b4-81b9-3fce7af24967 None None] MFA Rules not processed for user `9814d055b4344eb09a5a1c0ce8c04e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:49.933164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-76c3171d-83c7-45b4-81b9-3fce7af24967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:49.937359 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:49.945323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1232/2460] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:49 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:18:49.951570 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c0f17-86c7-4228-b446-96d74d03eef5 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:50.035643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1229/2461] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:18:50.039370 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c0f17-86c7-4228-b446-96d74d03eef5 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:50.047018 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3171d-83c7-45b4-81b9-3fce7af24967 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:50.048250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a8471-6a5f-427d-ad25-397077fa0ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:50.048482 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-76c3171d-83c7-45b4-81b9-3fce7af24967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:50.049142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8471-6a5f-427d-ad25-397077fa0ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:50.049525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8471-6a5f-427d-ad25-397077fa0ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:50.049881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a8471-6a5f-427d-ad25-397077fa0ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:50.050651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a8471-6a5f-427d-ad25-397077fa0ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:50.052709 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a8471-6a5f-427d-ad25-397077fa0ee1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:50.123466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3171d-83c7-45b4-81b9-3fce7af24967 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:50.176350 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1233/2462] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:49 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:50.177411 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a8471-6a5f-427d-ad25-397077fa0ee1 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:50.181373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452b50c-6559-4ed5-b36b-d59074d63383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:50.181871 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452b50c-6559-4ed5-b36b-d59074d63383 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:50.182261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452b50c-6559-4ed5-b36b-d59074d63383 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:50.182672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452b50c-6559-4ed5-b36b-d59074d63383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:50.187871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a8471-6a5f-427d-ad25-397077fa0ee1 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:50.195514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbd8d6-2bf9-4873-b511-e8e6dcc67c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:50.196322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbd8d6-2bf9-4873-b511-e8e6dcc67c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:50.196623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbd8d6-2bf9-4873-b511-e8e6dcc67c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:50.196945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbd8d6-2bf9-4873-b511-e8e6dcc67c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:50.197688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbd8d6-2bf9-4873-b511-e8e6dcc67c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:50.199467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbd8d6-2bf9-4873-b511-e8e6dcc67c53 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:50.210970 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1234/2463] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:50.214378 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbd8d6-2bf9-4873-b511-e8e6dcc67c53 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:50.226776 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbd8d6-2bf9-4873-b511-e8e6dcc67c53 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:50.232990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488bb1d-d057-41c3-85d3-9bcefb201f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:50.234103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488bb1d-d057-41c3-85d3-9bcefb201f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:50.234399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488bb1d-d057-41c3-85d3-9bcefb201f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:50.234698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488bb1d-d057-41c3-85d3-9bcefb201f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:50.235800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488bb1d-d057-41c3-85d3-9bcefb201f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:50.237566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488bb1d-d057-41c3-85d3-9bcefb201f6a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:50.250855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1235/2464] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:50.255206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488bb1d-d057-41c3-85d3-9bcefb201f6a admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:50.261988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452b50c-6559-4ed5-b36b-d59074d63383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:50.268388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452b50c-6559-4ed5-b36b-d59074d63383 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:50.268522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488bb1d-d057-41c3-85d3-9bcefb201f6a admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:50.272817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751451e-cee3-4e40-836c-bbf7ecf2c2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:50.273898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751451e-cee3-4e40-836c-bbf7ecf2c2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:50.274261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751451e-cee3-4e40-836c-bbf7ecf2c2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:50.274611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751451e-cee3-4e40-836c-bbf7ecf2c2c1 admin admin] PATH_INFO: `/v3/projects/5e6fd5b6f1a145ee9f723c000c0ec186/users/64513488e9ff45cab0baf683ce41cca1/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:50.276134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1230/2465] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:18:50.297499 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751451e-cee3-4e40-836c-bbf7ecf2c2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6fd5b6f1a145ee9f723c000c0ec186, user_id=64513488e9ff45cab0baf683ce41cca1, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:50.300284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751451e-cee3-4e40-836c-bbf7ecf2c2c1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:50.442542 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1236/2466] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:50 2022] PUT /identity/v3/projects/5e6fd5b6f1a145ee9f723c000c0ec186/users/64513488e9ff45cab0baf683ce41cca1/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:50.454201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ec513-b864-4b44-8770-f47d005513bf None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:50.454522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ec513-b864-4b44-8770-f47d005513bf None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:50.454770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ec513-b864-4b44-8770-f47d005513bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:50.480311 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e54ec513-b864-4b44-8770-f47d005513bf None None] MFA Rules not processed for user `64513488e9ff45cab0baf683ce41cca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:50.481967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e54ec513-b864-4b44-8770-f47d005513bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:50.533349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751451e-cee3-4e40-836c-bbf7ecf2c2c1 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:50.570944 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1231/2467] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:50.580476 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ec513-b864-4b44-8770-f47d005513bf None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:50.620179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751451e-cee3-4e40-836c-bbf7ecf2c2c1 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:50.624489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6058e1-5809-4aa4-be6b-276d013ce4cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:50.625314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6058e1-5809-4aa4-be6b-276d013ce4cb service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:50.625609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6058e1-5809-4aa4-be6b-276d013ce4cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:50.626039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6058e1-5809-4aa4-be6b-276d013ce4cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:50.640101 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-bb6058e1-5809-4aa4-be6b-276d013ce4cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:50.661223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ec513-b864-4b44-8770-f47d005513bf None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:50.663889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76775b1d-3c98-4067-8b67-b90ea686214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:50.664685 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76775b1d-3c98-4067-8b67-b90ea686214c admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:50.665079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76775b1d-3c98-4067-8b67-b90ea686214c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:50.665568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76775b1d-3c98-4067-8b67-b90ea686214c admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:50.669273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76775b1d-3c98-4067-8b67-b90ea686214c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:50.669273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76775b1d-3c98-4067-8b67-b90ea686214c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:50.758739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6058e1-5809-4aa4-be6b-276d013ce4cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:50.763729 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6058e1-5809-4aa4-be6b-276d013ce4cb service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:50.763868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:50.787067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1232/2468] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:18:50 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:18:50.787612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1237/2469] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:50.798473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76775b1d-3c98-4067-8b67-b90ea686214c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:50.883422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76775b1d-3c98-4067-8b67-b90ea686214c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:50.888493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b78434-ef38-4af1-b1f2-5e705562fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:50.894757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b78434-ef38-4af1-b1f2-5e705562fd24 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:50.894757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b78434-ef38-4af1-b1f2-5e705562fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:50.894757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b78434-ef38-4af1-b1f2-5e705562fd24 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:50.894757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b78434-ef38-4af1-b1f2-5e705562fd24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:50.894757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b78434-ef38-4af1-b1f2-5e705562fd24 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:50.992645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1233/2470] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:18:50 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:18:50.996565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6058e1-5809-4aa4-be6b-276d013ce4cb service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:51.007456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6058e1-5809-4aa4-be6b-276d013ce4cb service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:51.012121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36916e34-a39d-4057-937f-346efc47e84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:51.012888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36916e34-a39d-4057-937f-346efc47e84f admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:51.013343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36916e34-a39d-4057-937f-346efc47e84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:51.013481 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36916e34-a39d-4057-937f-346efc47e84f admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:51.014204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36916e34-a39d-4057-937f-346efc47e84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:51.015893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36916e34-a39d-4057-937f-346efc47e84f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:51.026140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1238/2471] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:51.030980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b78434-ef38-4af1-b1f2-5e705562fd24 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:51.041361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b78434-ef38-4af1-b1f2-5e705562fd24 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:51.046689 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c0dc8-0cf0-4800-9065-3e53c7c0a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:51.047556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c0dc8-0cf0-4800-9065-3e53c7c0a3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:51.047865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c0dc8-0cf0-4800-9065-3e53c7c0a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:51.048140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c0dc8-0cf0-4800-9065-3e53c7c0a3aa admin admin] PATH_INFO: `/v3/projects/1dedf28949cd46f7a7cff77bbe864cf5/users/15967c230f0f4117bee638a76813d05a/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:51.063221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c0dc8-0cf0-4800-9065-3e53c7c0a3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dedf28949cd46f7a7cff77bbe864cf5, user_id=15967c230f0f4117bee638a76813d05a, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:51.066085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c0dc8-0cf0-4800-9065-3e53c7c0a3aa admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:51.135414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1234/2472] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:51 2022] PUT /identity/v3/projects/1dedf28949cd46f7a7cff77bbe864cf5/users/15967c230f0f4117bee638a76813d05a/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:51.140422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36916e34-a39d-4057-937f-346efc47e84f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:51.151026 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36916e34-a39d-4057-937f-346efc47e84f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:51.209465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24782c34-0ce3-48c6-b8bb-cbafd21d9e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:51.210141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24782c34-0ce3-48c6-b8bb-cbafd21d9e19 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:51.210517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24782c34-0ce3-48c6-b8bb-cbafd21d9e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:51.210823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24782c34-0ce3-48c6-b8bb-cbafd21d9e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:51.211597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24782c34-0ce3-48c6-b8bb-cbafd21d9e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:51.213357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24782c34-0ce3-48c6-b8bb-cbafd21d9e19 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:51.223876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1239/2473] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:18:51.227334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:51.228082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c0dc8-0cf0-4800-9065-3e53c7c0a3aa admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:51.239560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c0dc8-0cf0-4800-9065-3e53c7c0a3aa admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:51.244360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0872c6-214e-4a09-b92d-d4674daec313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:51.245204 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0872c6-214e-4a09-b92d-d4674daec313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:51.245488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0872c6-214e-4a09-b92d-d4674daec313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:51.245767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0872c6-214e-4a09-b92d-d4674daec313 admin admin] PATH_INFO: `/v3/projects/1dedf28949cd46f7a7cff77bbe864cf5/users/15967c230f0f4117bee638a76813d05a/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:51.248499 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0872c6-214e-4a09-b92d-d4674daec313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dedf28949cd46f7a7cff77bbe864cf5, user_id=15967c230f0f4117bee638a76813d05a, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:51.251172 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0872c6-214e-4a09-b92d-d4674daec313 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:51.261496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1235/2474] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:18:51 2022] PUT /identity/v3/projects/1dedf28949cd46f7a7cff77bbe864cf5/users/15967c230f0f4117bee638a76813d05a/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:18:51.272138 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfc755-fc74-4c2e-a012-1705a92502a8 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:51.272451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfc755-fc74-4c2e-a012-1705a92502a8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:51.272737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfc755-fc74-4c2e-a012-1705a92502a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:51.298910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-88dfc755-fc74-4c2e-a012-1705a92502a8 None None] MFA Rules not processed for user `15967c230f0f4117bee638a76813d05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:51.300218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-88dfc755-fc74-4c2e-a012-1705a92502a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:51.368153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1240/2475] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:51.379894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0872c6-214e-4a09-b92d-d4674daec313 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:51.385901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-aa0872c6-214e-4a09-b92d-d4674daec313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:51.439079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0872c6-214e-4a09-b92d-d4674daec313 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:51.444267 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53144c69-c573-4af7-aaff-f72d0a744e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:51.444915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144c69-c573-4af7-aaff-f72d0a744e45 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:51.445201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144c69-c573-4af7-aaff-f72d0a744e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:51.445479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144c69-c573-4af7-aaff-f72d0a744e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:51.515302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53144c69-c573-4af7-aaff-f72d0a744e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:51.516818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53144c69-c573-4af7-aaff-f72d0a744e45 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:51.526197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1236/2476] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:51.741203 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:52.356885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfc755-fc74-4c2e-a012-1705a92502a8 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:52.359799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-88dfc755-fc74-4c2e-a012-1705a92502a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:52.459960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfc755-fc74-4c2e-a012-1705a92502a8 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:52.467723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fc6ce-d19c-4ace-8a4b-8c8fd4e0ec18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:52.468457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fc6ce-d19c-4ace-8a4b-8c8fd4e0ec18 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:52.468757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fc6ce-d19c-4ace-8a4b-8c8fd4e0ec18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:52.469045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fc6ce-d19c-4ace-8a4b-8c8fd4e0ec18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:52.472623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d38fc6ce-d19c-4ace-8a4b-8c8fd4e0ec18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:52.511891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:52.571340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fc6ce-d19c-4ace-8a4b-8c8fd4e0ec18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:52.573213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fc6ce-d19c-4ace-8a4b-8c8fd4e0ec18 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:52.588347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1241/2477] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:56.169030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3132b1-2762-4854-84fe-d8e3c69693ac None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:56.169950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3132b1-2762-4854-84fe-d8e3c69693ac None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:56.170436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3132b1-2762-4854-84fe-d8e3c69693ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:56.180915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:56.199323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ae3132b1-2762-4854-84fe-d8e3c69693ac None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:56.200949 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ae3132b1-2762-4854-84fe-d8e3c69693ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:56.279322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1237/2478] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 2 10:18:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:56.292343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fc6ce-d19c-4ace-8a4b-8c8fd4e0ec18 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:56.294341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d38fc6ce-d19c-4ace-8a4b-8c8fd4e0ec18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:56.382901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fc6ce-d19c-4ace-8a4b-8c8fd4e0ec18 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:56.389056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5f0c3-602c-4a36-832b-9122d87222e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:56.389710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5f0c3-602c-4a36-832b-9122d87222e1 service swift] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:56.389993 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5f0c3-602c-4a36-832b-9122d87222e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:56.390271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5f0c3-602c-4a36-832b-9122d87222e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:56.399249 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5f0c3-602c-4a36-832b-9122d87222e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:56.400887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5f0c3-602c-4a36-832b-9122d87222e1 service swift] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:56.409928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1242/2479] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:18:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:18:57.261053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3132b1-2762-4854-84fe-d8e3c69693ac None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:57.271407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3132b1-2762-4854-84fe-d8e3c69693ac None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:57.275311 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e4614-52cc-441c-937a-6d68e18b3cd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:57.276152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e4614-52cc-441c-937a-6d68e18b3cd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:57.276443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e4614-52cc-441c-937a-6d68e18b3cd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:57.276723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e4614-52cc-441c-937a-6d68e18b3cd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:57.291682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e4614-52cc-441c-937a-6d68e18b3cd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:57.291682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e4614-52cc-441c-937a-6d68e18b3cd1 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:57.300247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1238/2480] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:57.920599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5f0c3-602c-4a36-832b-9122d87222e1 service swift] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:57.987607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5f0c3-602c-4a36-832b-9122d87222e1 service swift] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:57.992537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:57.993421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:57.993729 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:57.994000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] PATH_INFO: `/v3/users/4140f62cd1ca40f89e2eaa339092c665` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:57.995215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4140f62cd1ca40f89e2eaa339092c665)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:57.997261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:58.214571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4140f62cd1ca40f89e2eaa339092c665'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:58.217418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:58.229689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4140f62cd1ca40f89e2eaa339092c665'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:58.230436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4140f62cd1ca40f89e2eaa339092c665'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:58.238452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4140f62cd1ca40f89e2eaa339092c665'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:58.239129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4140f62cd1ca40f89e2eaa339092c665'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:58.363288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1243/2481] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:57 2022] DELETE /identity/v3/users/4140f62cd1ca40f89e2eaa339092c665 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:58.368138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc4529-fb50-4850-b82c-7d56a296a9dd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:58.368761 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc4529-fb50-4850-b82c-7d56a296a9dd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:58.368981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc4529-fb50-4850-b82c-7d56a296a9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:58.389320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-91fc4529-fb50-4850-b82c-7d56a296a9dd None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:18:58.389610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-91fc4529-fb50-4850-b82c-7d56a296a9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:58.451925 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1239/2482] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:18:58.463186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:58.464930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:58.539510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3aea8-b379-4b89-86d1-68ba2445a0bc admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:58.544379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1460c-cd36-4e42-ac46-28952cd1acbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:58.545147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1460c-cd36-4e42-ac46-28952cd1acbf service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:58.545438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1460c-cd36-4e42-ac46-28952cd1acbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:58.545721 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1460c-cd36-4e42-ac46-28952cd1acbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:58.556270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1460c-cd36-4e42-ac46-28952cd1acbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:58.557731 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1460c-cd36-4e42-ac46-28952cd1acbf service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:58.568104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1244/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:18:59.087320 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc4529-fb50-4850-b82c-7d56a296a9dd None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:59.090038 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-91fc4529-fb50-4850-b82c-7d56a296a9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:18:59.113662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc4529-fb50-4850-b82c-7d56a296a9dd None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:59.113662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:59.113662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:59.113662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:59.114455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] PATH_INFO: `/v3/projects/426383f03e934c0da352e1fac9576778` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:59.114455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=426383f03e934c0da352e1fac9576778)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:59.115258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:59.233750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426383f03e934c0da352e1fac9576778', 'request_id': 'req-40042938-1224-47f5-bef9-a5af0b3ce4be'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:59.239266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426383f03e934c0da352e1fac9576778', 'request_id': 'req-40042938-1224-47f5-bef9-a5af0b3ce4be'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:59.245544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426383f03e934c0da352e1fac9576778', 'request_id': 'req-40042938-1224-47f5-bef9-a5af0b3ce4be'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:59.329254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] The token cache is being invalidate because project 426383f03e934c0da352e1fac9576778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:18:59.329555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:59.330298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:59.331995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1240/2484] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:18:59 2022] DELETE /identity/v3/projects/426383f03e934c0da352e1fac9576778 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:18:59.337248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1460c-cd36-4e42-ac46-28952cd1acbf service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:18:59.348959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1460c-cd36-4e42-ac46-28952cd1acbf service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:18:59.408512 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7efc3c-e743-4b4e-bfe2-92ed97a52da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:18:59.409471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7efc3c-e743-4b4e-bfe2-92ed97a52da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:18:59.409736 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7efc3c-e743-4b4e-bfe2-92ed97a52da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:18:59.410014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7efc3c-e743-4b4e-bfe2-92ed97a52da6 admin admin] PATH_INFO: `/v3/users/9814d055b4344eb09a5a1c0ce8c04e4e` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:18:59.411213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7efc3c-e743-4b4e-bfe2-92ed97a52da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9814d055b4344eb09a5a1c0ce8c04e4e)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:18:59.413271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7efc3c-e743-4b4e-bfe2-92ed97a52da6 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:18:59.619160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ef7efc3c-e743-4b4e-bfe2-92ed97a52da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9814d055b4344eb09a5a1c0ce8c04e4e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:59.632285 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ef7efc3c-e743-4b4e-bfe2-92ed97a52da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9814d055b4344eb09a5a1c0ce8c04e4e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:59.633086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ef7efc3c-e743-4b4e-bfe2-92ed97a52da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9814d055b4344eb09a5a1c0ce8c04e4e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:59.637803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:18:59.640664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ef7efc3c-e743-4b4e-bfe2-92ed97a52da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9814d055b4344eb09a5a1c0ce8c04e4e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:59.641319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ef7efc3c-e743-4b4e-bfe2-92ed97a52da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9814d055b4344eb09a5a1c0ce8c04e4e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:18:59.724724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1245/2485] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:18:59 2022] DELETE /identity/v3/users/9814d055b4344eb09a5a1c0ce8c04e4e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:00.260524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:00.262362 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:00.275168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042938-1224-47f5-bef9-a5af0b3ce4be admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:00.294652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:00.339822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:00.341263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:00.341539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:00.341820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] PATH_INFO: `/v3/projects/7e17f3e3a8cf43a399341e114e4b26b0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:00.343030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e17f3e3a8cf43a399341e114e4b26b0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:00.344999 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:00.427670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e17f3e3a8cf43a399341e114e4b26b0', 'request_id': 'req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:00.433238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e17f3e3a8cf43a399341e114e4b26b0', 'request_id': 'req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:00.440423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e17f3e3a8cf43a399341e114e4b26b0', 'request_id': 'req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:00.497388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] The token cache is being invalidate because project 7e17f3e3a8cf43a399341e114e4b26b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:00.497678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:00.498312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac77835f-baa6-425b-8c9f-bfd1537e0e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:00.500164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1241/2486] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:00 2022] DELETE /identity/v3/projects/7e17f3e3a8cf43a399341e114e4b26b0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:00.505101 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93016931-90a5-4d27-a6fc-77eb4bae4131 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:00.505624 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93016931-90a5-4d27-a6fc-77eb4bae4131 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:00.505969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93016931-90a5-4d27-a6fc-77eb4bae4131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:00.525951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-93016931-90a5-4d27-a6fc-77eb4bae4131 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:00.527202 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-93016931-90a5-4d27-a6fc-77eb4bae4131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:00.596099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1246/2487] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:00.597821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617bd19-dde2-4938-8e9f-ace2e3f0cc3e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:00.598117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617bd19-dde2-4938-8e9f-ace2e3f0cc3e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:00.598404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617bd19-dde2-4938-8e9f-ace2e3f0cc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:00.618637 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4617bd19-dde2-4938-8e9f-ace2e3f0cc3e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:00.619993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4617bd19-dde2-4938-8e9f-ace2e3f0cc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:00.629951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1242/2488] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:00.634495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93016931-90a5-4d27-a6fc-77eb4bae4131 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:00.646621 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93016931-90a5-4d27-a6fc-77eb4bae4131 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:00.651596 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46eab-dd97-4dcd-aa1d-0a6803c68e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:00.652347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46eab-dd97-4dcd-aa1d-0a6803c68e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:00.653271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46eab-dd97-4dcd-aa1d-0a6803c68e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:00.653763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e46eab-dd97-4dcd-aa1d-0a6803c68e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:00.654636 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e46eab-dd97-4dcd-aa1d-0a6803c68e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:19:00.655015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e46eab-dd97-4dcd-aa1d-0a6803c68e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:00.656711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e46eab-dd97-4dcd-aa1d-0a6803c68e94 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:00.669591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1247/2489] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:19:00.675658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617bd19-dde2-4938-8e9f-ace2e3f0cc3e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:00.683501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617bd19-dde2-4938-8e9f-ace2e3f0cc3e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:00.688774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a4cf6-7c1b-49ed-bea4-f8bd4ba0e280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:00.689553 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a4cf6-7c1b-49ed-bea4-f8bd4ba0e280 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:00.689844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a4cf6-7c1b-49ed-bea4-f8bd4ba0e280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:00.690124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a4cf6-7c1b-49ed-bea4-f8bd4ba0e280 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:00.690832 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a4cf6-7c1b-49ed-bea4-f8bd4ba0e280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:00.692807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a4cf6-7c1b-49ed-bea4-f8bd4ba0e280 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:00.775612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1243/2490] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:00 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:00.776936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46eab-dd97-4dcd-aa1d-0a6803c68e94 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:00.790211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e46eab-dd97-4dcd-aa1d-0a6803c68e94 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:00.869066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f44e7-47b6-4cbb-abc6-4643ebfb0c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:00.879613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f44e7-47b6-4cbb-abc6-4643ebfb0c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:00.879613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f44e7-47b6-4cbb-abc6-4643ebfb0c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:00.879613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f44e7-47b6-4cbb-abc6-4643ebfb0c79 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:00.879613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f44e7-47b6-4cbb-abc6-4643ebfb0c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:00.883043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f44e7-47b6-4cbb-abc6-4643ebfb0c79 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:00.976810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1248/2491] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:00 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:00.984470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a4cf6-7c1b-49ed-bea4-f8bd4ba0e280 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:00.996498 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a4cf6-7c1b-49ed-bea4-f8bd4ba0e280 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:01.001856 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3d3ca-1e2d-40ec-8b50-ffc45c149f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:01.002533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3d3ca-1e2d-40ec-8b50-ffc45c149f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:01.002933 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3d3ca-1e2d-40ec-8b50-ffc45c149f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:01.003089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3d3ca-1e2d-40ec-8b50-ffc45c149f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:01.003852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3d3ca-1e2d-40ec-8b50-ffc45c149f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:01.006031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3d3ca-1e2d-40ec-8b50-ffc45c149f3d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:01.019649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1244/2492] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:01.023463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f44e7-47b6-4cbb-abc6-4643ebfb0c79 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:01.045428 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f44e7-47b6-4cbb-abc6-4643ebfb0c79 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:01.051989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f7efa-cb6e-46aa-8052-08e8d6d6fbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:01.053177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f7efa-cb6e-46aa-8052-08e8d6d6fbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:01.053515 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f7efa-cb6e-46aa-8052-08e8d6d6fbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:01.053868 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f7efa-cb6e-46aa-8052-08e8d6d6fbc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:01.055057 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f7efa-cb6e-46aa-8052-08e8d6d6fbc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:01.057539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f7efa-cb6e-46aa-8052-08e8d6d6fbc4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:01.071930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1249/2493] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:01.076190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3d3ca-1e2d-40ec-8b50-ffc45c149f3d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:01.094919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3d3ca-1e2d-40ec-8b50-ffc45c149f3d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:01.104690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5840698-016d-43fa-987f-3134022556b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:01.106337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5840698-016d-43fa-987f-3134022556b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:01.106795 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5840698-016d-43fa-987f-3134022556b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:01.107434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5840698-016d-43fa-987f-3134022556b4 admin admin] PATH_INFO: `/v3/projects/93f27ca480b044ac9842294211adb5ac/users/b005a082b58f45c78de68259babe73c2/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:01.131675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5840698-016d-43fa-987f-3134022556b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f27ca480b044ac9842294211adb5ac, user_id=b005a082b58f45c78de68259babe73c2, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:01.134797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5840698-016d-43fa-987f-3134022556b4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:01.222680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1245/2494] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:01 2022] PUT /identity/v3/projects/93f27ca480b044ac9842294211adb5ac/users/b005a082b58f45c78de68259babe73c2/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:01.224883 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731e24b-ff4f-475f-87e1-fe96a4cd11ce None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:01.225273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731e24b-ff4f-475f-87e1-fe96a4cd11ce None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:01.225628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731e24b-ff4f-475f-87e1-fe96a4cd11ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:01.258236 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5731e24b-ff4f-475f-87e1-fe96a4cd11ce None None] MFA Rules not processed for user `b005a082b58f45c78de68259babe73c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:01.258816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5731e24b-ff4f-475f-87e1-fe96a4cd11ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:01.307523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:01.332297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1250/2495] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:01.336825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5840698-016d-43fa-987f-3134022556b4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:01.392897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:01.408643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5840698-016d-43fa-987f-3134022556b4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:01.413671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca7770-b35d-4174-be44-43fe42c5d7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:01.414484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7770-b35d-4174-be44-43fe42c5d7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:01.415813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7770-b35d-4174-be44-43fe42c5d7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:01.415813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca7770-b35d-4174-be44-43fe42c5d7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:01.416061 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca7770-b35d-4174-be44-43fe42c5d7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:01.418047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca7770-b35d-4174-be44-43fe42c5d7e4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:01.510634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1246/2496] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:01 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:01.514882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731e24b-ff4f-475f-87e1-fe96a4cd11ce None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:01.527031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731e24b-ff4f-475f-87e1-fe96a4cd11ce None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:01.585161 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839e751-67d1-4483-870f-734a68ed8b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:01.585840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839e751-67d1-4483-870f-734a68ed8b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:01.586127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839e751-67d1-4483-870f-734a68ed8b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:01.586409 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839e751-67d1-4483-870f-734a68ed8b48 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:01.587123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839e751-67d1-4483-870f-734a68ed8b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:01.589150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839e751-67d1-4483-870f-734a68ed8b48 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:01.690434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1251/2497] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:01 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:01.694388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca7770-b35d-4174-be44-43fe42c5d7e4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:01.705816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca7770-b35d-4174-be44-43fe42c5d7e4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:01.710711 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ef052-08e2-4467-905d-1a225c072cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:01.711517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ef052-08e2-4467-905d-1a225c072cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:01.711876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ef052-08e2-4467-905d-1a225c072cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:01.712160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ef052-08e2-4467-905d-1a225c072cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:01.712989 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ef052-08e2-4467-905d-1a225c072cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:01.714485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ef052-08e2-4467-905d-1a225c072cb4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:01.726907 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1247/2498] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:01.731707 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839e751-67d1-4483-870f-734a68ed8b48 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:01.743322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839e751-67d1-4483-870f-734a68ed8b48 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:01.748292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7a250-651e-45bb-a59c-871fc768324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:01.749044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a250-651e-45bb-a59c-871fc768324d admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:01.758167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a250-651e-45bb-a59c-871fc768324d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:01.758167 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a250-651e-45bb-a59c-871fc768324d admin admin] PATH_INFO: `/v3/projects/0a6ac3ea3f1f48d6833643be2cba2cf3/users/bde0585b232849968355a38f3a6523f9/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:01.767459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7a250-651e-45bb-a59c-871fc768324d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6ac3ea3f1f48d6833643be2cba2cf3, user_id=bde0585b232849968355a38f3a6523f9, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:01.770459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7a250-651e-45bb-a59c-871fc768324d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:01.845675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1252/2499] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:01 2022] PUT /identity/v3/projects/0a6ac3ea3f1f48d6833643be2cba2cf3/users/bde0585b232849968355a38f3a6523f9/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:01.849705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ef052-08e2-4467-905d-1a225c072cb4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:01.867329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ef052-08e2-4467-905d-1a225c072cb4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:01.936448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49718324-4cc4-4e2c-8c57-faf6faa8bea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:01.940667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49718324-4cc4-4e2c-8c57-faf6faa8bea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:01.940667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49718324-4cc4-4e2c-8c57-faf6faa8bea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:01.940667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49718324-4cc4-4e2c-8c57-faf6faa8bea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:01.940667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49718324-4cc4-4e2c-8c57-faf6faa8bea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:01.941538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49718324-4cc4-4e2c-8c57-faf6faa8bea7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:01.963077 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1248/2500] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:01.967821 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7a250-651e-45bb-a59c-871fc768324d admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:01.979456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7a250-651e-45bb-a59c-871fc768324d admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:01.986545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3abb65-fed4-4146-b427-d33d59b5799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:01.987665 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3abb65-fed4-4146-b427-d33d59b5799f admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:01.988046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3abb65-fed4-4146-b427-d33d59b5799f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:01.988402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3abb65-fed4-4146-b427-d33d59b5799f admin admin] PATH_INFO: `/v3/projects/0a6ac3ea3f1f48d6833643be2cba2cf3/users/bde0585b232849968355a38f3a6523f9/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:01.990809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3abb65-fed4-4146-b427-d33d59b5799f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6ac3ea3f1f48d6833643be2cba2cf3, user_id=bde0585b232849968355a38f3a6523f9, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:01.993745 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3abb65-fed4-4146-b427-d33d59b5799f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:02.016212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1253/2501] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:01 2022] PUT /identity/v3/projects/0a6ac3ea3f1f48d6833643be2cba2cf3/users/bde0585b232849968355a38f3a6523f9/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:02.018327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cc85a-a01f-41d8-b29d-32b8b24bf626 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:02.018623 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cc85a-a01f-41d8-b29d-32b8b24bf626 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:02.018906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cc85a-a01f-41d8-b29d-32b8b24bf626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:02.048502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a84cc85a-a01f-41d8-b29d-32b8b24bf626 None None] MFA Rules not processed for user `bde0585b232849968355a38f3a6523f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:02.050125 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a84cc85a-a01f-41d8-b29d-32b8b24bf626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:02.128546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1249/2502] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:02.140563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3abb65-fed4-4146-b427-d33d59b5799f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:02.142252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8d3abb65-fed4-4146-b427-d33d59b5799f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:02.212126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3abb65-fed4-4146-b427-d33d59b5799f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:02.216354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2df6a9-f059-4434-a7b2-20b694530eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:02.217111 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2df6a9-f059-4434-a7b2-20b694530eaa service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:02.217400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2df6a9-f059-4434-a7b2-20b694530eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:02.217675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2df6a9-f059-4434-a7b2-20b694530eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:02.228551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2df6a9-f059-4434-a7b2-20b694530eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:02.229993 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2df6a9-f059-4434-a7b2-20b694530eaa service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:02.239858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1254/2503] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:02.355014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cc85a-a01f-41d8-b29d-32b8b24bf626 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:02.364495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cc85a-a01f-41d8-b29d-32b8b24bf626 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:02.368126 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248712f-2771-4e63-bc66-b7c4c11c8600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:02.368799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248712f-2771-4e63-bc66-b7c4c11c8600 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:02.369081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248712f-2771-4e63-bc66-b7c4c11c8600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:02.369586 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248712f-2771-4e63-bc66-b7c4c11c8600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:02.411274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:02.426906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248712f-2771-4e63-bc66-b7c4c11c8600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:02.428323 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248712f-2771-4e63-bc66-b7c4c11c8600 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:02.437429 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1250/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:02.990548 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2df6a9-f059-4434-a7b2-20b694530eaa service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:03.034077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:03.056175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2df6a9-f059-4434-a7b2-20b694530eaa service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:03.060760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eef60-359d-494c-ac8c-c953af434684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:03.061626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eef60-359d-494c-ac8c-c953af434684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:03.061907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eef60-359d-494c-ac8c-c953af434684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:03.062177 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eef60-359d-494c-ac8c-c953af434684 admin admin] PATH_INFO: `/v3/users/b005a082b58f45c78de68259babe73c2` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:03.063356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3eef60-359d-494c-ac8c-c953af434684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b005a082b58f45c78de68259babe73c2)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:03.065336 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3eef60-359d-494c-ac8c-c953af434684 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:03.240503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248712f-2771-4e63-bc66-b7c4c11c8600 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:03.242524 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1248712f-2771-4e63-bc66-b7c4c11c8600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:03.257790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248712f-2771-4e63-bc66-b7c4c11c8600 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:03.260723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7a3eef60-359d-494c-ac8c-c953af434684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b005a082b58f45c78de68259babe73c2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:03.263404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:03.264318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:03.264727 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:03.265065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] PATH_INFO: `/v3/users/64513488e9ff45cab0baf683ce41cca1` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:03.266509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64513488e9ff45cab0baf683ce41cca1)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:03.268950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:03.275559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7a3eef60-359d-494c-ac8c-c953af434684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b005a082b58f45c78de68259babe73c2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:03.276315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7a3eef60-359d-494c-ac8c-c953af434684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b005a082b58f45c78de68259babe73c2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:03.284265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7a3eef60-359d-494c-ac8c-c953af434684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b005a082b58f45c78de68259babe73c2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:03.285006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7a3eef60-359d-494c-ac8c-c953af434684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b005a082b58f45c78de68259babe73c2'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:03.365061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1255/2505] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:02 2022] DELETE /identity/v3/users/b005a082b58f45c78de68259babe73c2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:03.369500 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dc047-9412-4ac2-a68c-0659edb01147 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:03.370026 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dc047-9412-4ac2-a68c-0659edb01147 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:03.370580 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dc047-9412-4ac2-a68c-0659edb01147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:03.388622 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-757dc047-9412-4ac2-a68c-0659edb01147 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:03.389818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-757dc047-9412-4ac2-a68c-0659edb01147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:03.436601 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64513488e9ff45cab0baf683ce41cca1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:03.465039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1256/2506] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:03.475063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dc047-9412-4ac2-a68c-0659edb01147 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:03.476599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-757dc047-9412-4ac2-a68c-0659edb01147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:03.535991 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757dc047-9412-4ac2-a68c-0659edb01147 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:03.539993 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220011b-cac3-4afb-b3cb-792c10e5f21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:03.540540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64513488e9ff45cab0baf683ce41cca1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:03.540705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220011b-cac3-4afb-b3cb-792c10e5f21e service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:03.541094 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220011b-cac3-4afb-b3cb-792c10e5f21e service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:03.541438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220011b-cac3-4afb-b3cb-792c10e5f21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:03.551509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220011b-cac3-4afb-b3cb-792c10e5f21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:03.553055 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220011b-cac3-4afb-b3cb-792c10e5f21e service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:03.557760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64513488e9ff45cab0baf683ce41cca1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:03.559348 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:03.560440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64513488e9ff45cab0baf683ce41cca1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:03.561274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64513488e9ff45cab0baf683ce41cca1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:03.564714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1257/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:03.579707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1251/2508] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:03 2022] DELETE /identity/v3/users/64513488e9ff45cab0baf683ce41cca1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:03.584364 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661b5b1-b5d7-4d61-aa70-535601835165 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:03.584760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661b5b1-b5d7-4d61-aa70-535601835165 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:03.585138 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661b5b1-b5d7-4d61-aa70-535601835165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:03.605774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-b661b5b1-b5d7-4d61-aa70-535601835165 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:03.607387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b661b5b1-b5d7-4d61-aa70-535601835165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:03.678234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1258/2509] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:03.688954 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:03.693597 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:03.754346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23081d85-6e55-48c0-a7a0-4277cd8f2906 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:03.758171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41901aec-8d9b-473b-bba9-93f0f411a139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:03.758849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41901aec-8d9b-473b-bba9-93f0f411a139 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:03.759112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41901aec-8d9b-473b-bba9-93f0f411a139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:03.759394 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41901aec-8d9b-473b-bba9-93f0f411a139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:03.770399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41901aec-8d9b-473b-bba9-93f0f411a139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:03.772069 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41901aec-8d9b-473b-bba9-93f0f411a139 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:03.784264 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1252/2510] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:04.128067 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661b5b1-b5d7-4d61-aa70-535601835165 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:04.129591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b661b5b1-b5d7-4d61-aa70-535601835165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:04.143190 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661b5b1-b5d7-4d61-aa70-535601835165 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:04.148627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:04.160424 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:04.160721 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:04.161005 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] PATH_INFO: `/v3/projects/93f27ca480b044ac9842294211adb5ac` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:04.162735 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f27ca480b044ac9842294211adb5ac)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:04.164794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:04.258200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41901aec-8d9b-473b-bba9-93f0f411a139 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:04.262880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-41901aec-8d9b-473b-bba9-93f0f411a139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:04.283486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f27ca480b044ac9842294211adb5ac', 'request_id': 'req-fb4d49b9-6f08-40fc-817e-801de06c5c9d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.284025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41901aec-8d9b-473b-bba9-93f0f411a139 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:04.342035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:04.348693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:04.349630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:04.349913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:04.350194 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] PATH_INFO: `/v3/projects/5e6fd5b6f1a145ee9f723c000c0ec186` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:04.351376 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6fd5b6f1a145ee9f723c000c0ec186)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:04.353317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:04.364685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f27ca480b044ac9842294211adb5ac', 'request_id': 'req-fb4d49b9-6f08-40fc-817e-801de06c5c9d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.371555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f27ca480b044ac9842294211adb5ac', 'request_id': 'req-fb4d49b9-6f08-40fc-817e-801de06c5c9d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.382559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] The token cache is being invalidate because project 93f27ca480b044ac9842294211adb5ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:04.382853 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.383601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.385403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1259/2511] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:04 2022] DELETE /identity/v3/projects/93f27ca480b044ac9842294211adb5ac => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:04.389441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:04.390984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:04.404616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d49b9-6f08-40fc-817e-801de06c5c9d admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:04.409589 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:04.410608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:04.410894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:04.411173 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] PATH_INFO: `/v3/users/bde0585b232849968355a38f3a6523f9` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:04.412494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde0585b232849968355a38f3a6523f9)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:04.414470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:04.462446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6fd5b6f1a145ee9f723c000c0ec186', 'request_id': 'req-02241e4f-1a83-4116-ae22-9497a563582a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.469176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6fd5b6f1a145ee9f723c000c0ec186', 'request_id': 'req-02241e4f-1a83-4116-ae22-9497a563582a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.475287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6fd5b6f1a145ee9f723c000c0ec186', 'request_id': 'req-02241e4f-1a83-4116-ae22-9497a563582a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.559313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] The token cache is being invalidate because project 5e6fd5b6f1a145ee9f723c000c0ec186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:04.562333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.562333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.562333 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1253/2512] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:04 2022] DELETE /identity/v3/projects/5e6fd5b6f1a145ee9f723c000c0ec186 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:04.566044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:04.567364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:04.625964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde0585b232849968355a38f3a6523f9'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.632444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02241e4f-1a83-4116-ae22-9497a563582a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:04.638562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:04.638885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde0585b232849968355a38f3a6523f9'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.639568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde0585b232849968355a38f3a6523f9'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.639849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:04.640461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:04.641866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] PATH_INFO: `/v3/users/15967c230f0f4117bee638a76813d05a` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:04.643453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15967c230f0f4117bee638a76813d05a)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:04.645666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:04.650127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde0585b232849968355a38f3a6523f9'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.650127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde0585b232849968355a38f3a6523f9'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.651627 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:04.730383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1260/2513] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:04 2022] DELETE /identity/v3/users/bde0585b232849968355a38f3a6523f9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:04.870673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15967c230f0f4117bee638a76813d05a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.936413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15967c230f0f4117bee638a76813d05a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.952328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15967c230f0f4117bee638a76813d05a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.953038 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15967c230f0f4117bee638a76813d05a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.953660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15967c230f0f4117bee638a76813d05a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:04.966825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1254/2514] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:04 2022] DELETE /identity/v3/users/15967c230f0f4117bee638a76813d05a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:05.115008 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:05.116472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:05.185769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f59bf-5991-4082-aad5-e0fd7f2bda73 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:05.243447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:05.244340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:05.244630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:05.244910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] PATH_INFO: `/v3/projects/0a6ac3ea3f1f48d6833643be2cba2cf3` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:05.246109 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6ac3ea3f1f48d6833643be2cba2cf3)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:05.248077 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:05.413626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:05.419052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:05.427218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6ac3ea3f1f48d6833643be2cba2cf3', 'request_id': 'req-2f6a644b-e0ce-4621-af03-745a36eeb56f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:05.435743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:05.441188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cf3f1-ce78-4834-ab43-46a1a3230129 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:05.500521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:05.501382 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:05.501669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:05.501952 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] PATH_INFO: `/v3/projects/1dedf28949cd46f7a7cff77bbe864cf5` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:05.503148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dedf28949cd46f7a7cff77bbe864cf5)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:05.505136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:05.513480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6ac3ea3f1f48d6833643be2cba2cf3', 'request_id': 'req-2f6a644b-e0ce-4621-af03-745a36eeb56f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:05.520957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6ac3ea3f1f48d6833643be2cba2cf3', 'request_id': 'req-2f6a644b-e0ce-4621-af03-745a36eeb56f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:05.533269 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] The token cache is being invalidate because project 0a6ac3ea3f1f48d6833643be2cba2cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:05.533654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:05.534392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f6a644b-e0ce-4621-af03-745a36eeb56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:05.536002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1261/2515] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:05 2022] DELETE /identity/v3/projects/0a6ac3ea3f1f48d6833643be2cba2cf3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:05.540699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9fc30-ce33-45be-8d84-171ebc1e4954 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:05.540994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9fc30-ce33-45be-8d84-171ebc1e4954 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:05.541278 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9fc30-ce33-45be-8d84-171ebc1e4954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:05.559526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-ecd9fc30-ce33-45be-8d84-171ebc1e4954 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:05.560740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ecd9fc30-ce33-45be-8d84-171ebc1e4954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:05.568617 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1262/2516] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:05.576834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097c8f-90d1-453a-9241-3353f1fd4c1d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:05.577140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097c8f-90d1-453a-9241-3353f1fd4c1d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:05.577417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6097c8f-90d1-453a-9241-3353f1fd4c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:05.595301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e6097c8f-90d1-453a-9241-3353f1fd4c1d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:05.596503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e6097c8f-90d1-453a-9241-3353f1fd4c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:05.604510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1263/2517] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:05.608910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6097c8f-90d1-453a-9241-3353f1fd4c1d None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:05.620171 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dedf28949cd46f7a7cff77bbe864cf5', 'request_id': 'req-df52a641-8f15-4d45-8f5b-28b704211def'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:05.620330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6097c8f-90d1-453a-9241-3353f1fd4c1d None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:05.621817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dedf28949cd46f7a7cff77bbe864cf5', 'request_id': 'req-df52a641-8f15-4d45-8f5b-28b704211def'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:05.628053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dedf28949cd46f7a7cff77bbe864cf5', 'request_id': 'req-df52a641-8f15-4d45-8f5b-28b704211def'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:05.634706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:05.676253 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc9c63-f665-4ec0-b9a4-0a9caf902fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:05.676946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc9c63-f665-4ec0-b9a4-0a9caf902fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:05.677229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc9c63-f665-4ec0-b9a4-0a9caf902fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:05.677505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc9c63-f665-4ec0-b9a4-0a9caf902fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:05.678226 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc9c63-f665-4ec0-b9a4-0a9caf902fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:19:05.678535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc9c63-f665-4ec0-b9a4-0a9caf902fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:05.680135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc9c63-f665-4ec0-b9a4-0a9caf902fd1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:05.693013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1264/2518] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:19:05.698042 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc9c63-f665-4ec0-b9a4-0a9caf902fd1 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:05.708536 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc9c63-f665-4ec0-b9a4-0a9caf902fd1 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:05.713234 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61ea35-de29-4b94-bb35-5f3582cb8485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:05.713866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61ea35-de29-4b94-bb35-5f3582cb8485 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:05.714150 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61ea35-de29-4b94-bb35-5f3582cb8485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:05.714425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61ea35-de29-4b94-bb35-5f3582cb8485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:05.715138 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61ea35-de29-4b94-bb35-5f3582cb8485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:05.717050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61ea35-de29-4b94-bb35-5f3582cb8485 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:05.757822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] The token cache is being invalidate because project 1dedf28949cd46f7a7cff77bbe864cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:05.758121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:05.758743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-df52a641-8f15-4d45-8f5b-28b704211def admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:05.760371 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1255/2519] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:05 2022] DELETE /identity/v3/projects/1dedf28949cd46f7a7cff77bbe864cf5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:05.766914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9af6da-972e-4cf9-ba92-4eff7d6c4785 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:05.767207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9af6da-972e-4cf9-ba92-4eff7d6c4785 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:05.767488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9af6da-972e-4cf9-ba92-4eff7d6c4785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:05.786986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ee9af6da-972e-4cf9-ba92-4eff7d6c4785 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:05.788234 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ee9af6da-972e-4cf9-ba92-4eff7d6c4785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:05.796969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1256/2520] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:05.806383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ada0e-95c9-47ef-b5a5-78d00691d575 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:05.806672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ada0e-95c9-47ef-b5a5-78d00691d575 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:05.806980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ada0e-95c9-47ef-b5a5-78d00691d575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:05.826833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-561ada0e-95c9-47ef-b5a5-78d00691d575 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:05.828112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-561ada0e-95c9-47ef-b5a5-78d00691d575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:05.836358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1257/2521] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:05.840889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ada0e-95c9-47ef-b5a5-78d00691d575 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:05.846480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1265/2522] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:05 2022] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:05.850368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61ea35-de29-4b94-bb35-5f3582cb8485 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:05.851085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ada0e-95c9-47ef-b5a5-78d00691d575 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:05.852198 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-3e61ea35-de29-4b94-bb35-5f3582cb8485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:05.921798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d4c1d-36ba-43cf-9a2d-ad9b41c647d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:05.922376 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d4c1d-36ba-43cf-9a2d-ad9b41c647d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:05.922661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d4c1d-36ba-43cf-9a2d-ad9b41c647d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:05.922940 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d4c1d-36ba-43cf-9a2d-ad9b41c647d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:05.923699 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d4c1d-36ba-43cf-9a2d-ad9b41c647d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:19:05.924041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d4c1d-36ba-43cf-9a2d-ad9b41c647d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:05.925712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d4c1d-36ba-43cf-9a2d-ad9b41c647d8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:05.929822 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61ea35-de29-4b94-bb35-5f3582cb8485 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:05.935557 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dce3b-c67c-40fc-88ac-5c02e74cde1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:05.936257 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dce3b-c67c-40fc-88ac-5c02e74cde1e admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:05.936548 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dce3b-c67c-40fc-88ac-5c02e74cde1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:05.936832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29dce3b-c67c-40fc-88ac-5c02e74cde1e admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:05.937529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dce3b-c67c-40fc-88ac-5c02e74cde1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:05.941488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1258/2523] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:19:05.941638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29dce3b-c67c-40fc-88ac-5c02e74cde1e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:05.942508 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d4c1d-36ba-43cf-9a2d-ad9b41c647d8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:05.953093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d4c1d-36ba-43cf-9a2d-ad9b41c647d8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:05.957845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1657be-6492-4ac5-a177-c197fd6d3a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:05.958497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1657be-6492-4ac5-a177-c197fd6d3a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:05.958791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1657be-6492-4ac5-a177-c197fd6d3a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:05.959073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1657be-6492-4ac5-a177-c197fd6d3a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:05.959796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1657be-6492-4ac5-a177-c197fd6d3a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:05.961701 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1657be-6492-4ac5-a177-c197fd6d3a2c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:05.992960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:06.021799 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1266/2524] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:05 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:06.025787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dce3b-c67c-40fc-88ac-5c02e74cde1e admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:06.035998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29dce3b-c67c-40fc-88ac-5c02e74cde1e admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:06.047044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1259/2525] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:05 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:06.047626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890b4f1-cd84-46c9-8737-3303151b2482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:06.048485 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890b4f1-cd84-46c9-8737-3303151b2482 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.048856 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890b4f1-cd84-46c9-8737-3303151b2482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.049117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890b4f1-cd84-46c9-8737-3303151b2482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.049982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890b4f1-cd84-46c9-8737-3303151b2482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:06.051802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890b4f1-cd84-46c9-8737-3303151b2482 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:06.052878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1657be-6492-4ac5-a177-c197fd6d3a2c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:06.065480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1267/2526] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:06.066615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890b4f1-cd84-46c9-8737-3303151b2482 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:06.079069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890b4f1-cd84-46c9-8737-3303151b2482 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:06.127835 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1657be-6492-4ac5-a177-c197fd6d3a2c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:06.133176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b34c3-a830-40ec-b1a2-6bbe906b4244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:06.133847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b34c3-a830-40ec-b1a2-6bbe906b4244 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.134164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b34c3-a830-40ec-b1a2-6bbe906b4244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.134453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b34c3-a830-40ec-b1a2-6bbe906b4244 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.135186 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b34c3-a830-40ec-b1a2-6bbe906b4244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:06.137756 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b34c3-a830-40ec-b1a2-6bbe906b4244 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:06.138029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cbe7e-c131-408e-ac34-7066a1691175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:06.138710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cbe7e-c131-408e-ac34-7066a1691175 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.139174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cbe7e-c131-408e-ac34-7066a1691175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.139667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cbe7e-c131-408e-ac34-7066a1691175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.140791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cbe7e-c131-408e-ac34-7066a1691175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:06.142898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cbe7e-c131-408e-ac34-7066a1691175 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:06.158237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1268/2527] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:06.159932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cbe7e-c131-408e-ac34-7066a1691175 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:06.170155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cbe7e-c131-408e-ac34-7066a1691175 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:06.177352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8c361-672b-4011-8565-ac1c61a88352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:06.177352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c361-672b-4011-8565-ac1c61a88352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.177352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c361-672b-4011-8565-ac1c61a88352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.177352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c361-672b-4011-8565-ac1c61a88352 admin admin] PATH_INFO: `/v3/projects/8e424a68c809469289da9199019c10db/users/351f01d7c18b49b2b8e358609b27e4d9/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.179075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:06.192139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8c361-672b-4011-8565-ac1c61a88352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e424a68c809469289da9199019c10db, user_id=351f01d7c18b49b2b8e358609b27e4d9, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:06.194792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8c361-672b-4011-8565-ac1c61a88352 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:06.210581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1260/2528] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:06 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:06.215535 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b34c3-a830-40ec-b1a2-6bbe906b4244 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:06.225758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b34c3-a830-40ec-b1a2-6bbe906b4244 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:06.230512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cb0d3-ed6c-4a11-b4b0-ed7af2c7f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:06.231165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cb0d3-ed6c-4a11-b4b0-ed7af2c7f164 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.231459 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cb0d3-ed6c-4a11-b4b0-ed7af2c7f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.231774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cb0d3-ed6c-4a11-b4b0-ed7af2c7f164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.232582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cb0d3-ed6c-4a11-b4b0-ed7af2c7f164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:06.234258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cb0d3-ed6c-4a11-b4b0-ed7af2c7f164 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:06.244330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1261/2529] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:06.248348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cb0d3-ed6c-4a11-b4b0-ed7af2c7f164 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:06.257829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cb0d3-ed6c-4a11-b4b0-ed7af2c7f164 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:06.263065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67eb1a-e2de-4e19-9222-8adb94f09119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:06.263805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67eb1a-e2de-4e19-9222-8adb94f09119 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.264101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67eb1a-e2de-4e19-9222-8adb94f09119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.264386 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67eb1a-e2de-4e19-9222-8adb94f09119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.265098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67eb1a-e2de-4e19-9222-8adb94f09119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:06.266653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67eb1a-e2de-4e19-9222-8adb94f09119 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:06.277395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1262/2530] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:06.278781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1269/2531] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:06 2022] PUT /identity/v3/projects/8e424a68c809469289da9199019c10db/users/351f01d7c18b49b2b8e358609b27e4d9/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:06.286865 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67eb1a-e2de-4e19-9222-8adb94f09119 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:06.289692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e9084-ce43-46f9-ba95-1d9ed8cfec92 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.289986 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e9084-ce43-46f9-ba95-1d9ed8cfec92 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.290268 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e9084-ce43-46f9-ba95-1d9ed8cfec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.292696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67eb1a-e2de-4e19-9222-8adb94f09119 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:06.316828 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-096e9084-ce43-46f9-ba95-1d9ed8cfec92 None None] MFA Rules not processed for user `351f01d7c18b49b2b8e358609b27e4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:06.318032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-096e9084-ce43-46f9-ba95-1d9ed8cfec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:06.350122 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea242f54-d81c-4865-a0da-bf3cb4824826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:06.351036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea242f54-d81c-4865-a0da-bf3cb4824826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.351317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea242f54-d81c-4865-a0da-bf3cb4824826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.351606 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea242f54-d81c-4865-a0da-bf3cb4824826 admin admin] PATH_INFO: `/v3/projects/fb5e2cd512d24162a7807565810380e6/users/848c135c9f324ab7ad499bd9f926c803/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.365891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea242f54-d81c-4865-a0da-bf3cb4824826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5e2cd512d24162a7807565810380e6, user_id=848c135c9f324ab7ad499bd9f926c803, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:06.368741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea242f54-d81c-4865-a0da-bf3cb4824826 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:06.382412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1270/2532] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:06.399181 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e9084-ce43-46f9-ba95-1d9ed8cfec92 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:06.400541 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-096e9084-ce43-46f9-ba95-1d9ed8cfec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:06.445313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1263/2533] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:06 2022] PUT /identity/v3/projects/fb5e2cd512d24162a7807565810380e6/users/848c135c9f324ab7ad499bd9f926c803/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:06.457100 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aee95-d8f6-441a-bbc7-0d60c4004cd0 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.457399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aee95-d8f6-441a-bbc7-0d60c4004cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.457681 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97aee95-d8f6-441a-bbc7-0d60c4004cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.458025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e9084-ce43-46f9-ba95-1d9ed8cfec92 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:06.485091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f97aee95-d8f6-441a-bbc7-0d60c4004cd0 None None] MFA Rules not processed for user `848c135c9f324ab7ad499bd9f926c803`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:06.486347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f97aee95-d8f6-441a-bbc7-0d60c4004cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:06.507086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0678a87-c2b5-4652-b4df-64faf65544c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:06.507989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0678a87-c2b5-4652-b4df-64faf65544c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.508354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0678a87-c2b5-4652-b4df-64faf65544c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.508637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0678a87-c2b5-4652-b4df-64faf65544c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.521301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:06.552468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:06.555627 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1264/2534] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:06.567721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aee95-d8f6-441a-bbc7-0d60c4004cd0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:06.568703 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0678a87-c2b5-4652-b4df-64faf65544c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:06.569255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f97aee95-d8f6-441a-bbc7-0d60c4004cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:06.570314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0678a87-c2b5-4652-b4df-64faf65544c7 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:06.579534 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1271/2535] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:19:06.582546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97aee95-d8f6-441a-bbc7-0d60c4004cd0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:06.586456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547e10b-f9d1-4d51-a4d4-f6d1194f6956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:06.587011 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547e10b-f9d1-4d51-a4d4-f6d1194f6956 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.587299 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547e10b-f9d1-4d51-a4d4-f6d1194f6956 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.587629 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547e10b-f9d1-4d51-a4d4-f6d1194f6956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.597428 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547e10b-f9d1-4d51-a4d4-f6d1194f6956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:06.598873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547e10b-f9d1-4d51-a4d4-f6d1194f6956 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:06.608475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1265/2536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:19:06.628743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0678a87-c2b5-4652-b4df-64faf65544c7 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:06.694092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0678a87-c2b5-4652-b4df-64faf65544c7 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:06.701999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:06.712121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:06.712121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:06.712121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] PATH_INFO: `/v3/users/848c135c9f324ab7ad499bd9f926c803` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:06.712121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=848c135c9f324ab7ad499bd9f926c803)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:06.712121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:06.950536 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848c135c9f324ab7ad499bd9f926c803'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:06.962561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848c135c9f324ab7ad499bd9f926c803'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:06.963307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848c135c9f324ab7ad499bd9f926c803'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:06.970766 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848c135c9f324ab7ad499bd9f926c803'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:06.975460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848c135c9f324ab7ad499bd9f926c803'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:07.061716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1272/2537] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:06 2022] DELETE /identity/v3/users/848c135c9f324ab7ad499bd9f926c803 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:07.066313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bf8ad-d9d5-4036-9025-d96fbcb01efd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:07.066632 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bf8ad-d9d5-4036-9025-d96fbcb01efd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:07.066913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2bf8ad-d9d5-4036-9025-d96fbcb01efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:07.085197 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9b2bf8ad-d9d5-4036-9025-d96fbcb01efd None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:07.086539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9b2bf8ad-d9d5-4036-9025-d96fbcb01efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:07.151515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1266/2538] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:07.162123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:07.163785 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:07.223241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e4f0c-645a-4f83-8c42-6ab9c8bca8a4 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:07.229590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66681e-f0ab-4559-ba70-a64fc4f95b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:07.229590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66681e-f0ab-4559-ba70-a64fc4f95b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:07.229590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66681e-f0ab-4559-ba70-a64fc4f95b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:07.229590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66681e-f0ab-4559-ba70-a64fc4f95b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:07.248415 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66681e-f0ab-4559-ba70-a64fc4f95b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:07.249967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66681e-f0ab-4559-ba70-a64fc4f95b29 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:07.260302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1273/2539] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:07.690899 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bf8ad-d9d5-4036-9025-d96fbcb01efd None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:07.692488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9b2bf8ad-d9d5-4036-9025-d96fbcb01efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:07.705806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2bf8ad-d9d5-4036-9025-d96fbcb01efd None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:07.711092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:07.712256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:07.712614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:07.712967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] PATH_INFO: `/v3/projects/fb5e2cd512d24162a7807565810380e6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:07.714297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5e2cd512d24162a7807565810380e6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:07.717129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:07.842020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5e2cd512d24162a7807565810380e6', 'request_id': 'req-8351bacf-5d7c-4d14-b00d-74d7be668795'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:07.848345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5e2cd512d24162a7807565810380e6', 'request_id': 'req-8351bacf-5d7c-4d14-b00d-74d7be668795'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:07.854950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5e2cd512d24162a7807565810380e6', 'request_id': 'req-8351bacf-5d7c-4d14-b00d-74d7be668795'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:07.913030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] The token cache is being invalidate because project fb5e2cd512d24162a7807565810380e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:07.913271 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:07.913870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8351bacf-5d7c-4d14-b00d-74d7be668795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:07.915420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1267/2540] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:07 2022] DELETE /identity/v3/projects/fb5e2cd512d24162a7807565810380e6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:07.920734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3abdc-cfde-44da-b897-dcbda058defe None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:07.921026 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3abdc-cfde-44da-b897-dcbda058defe None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:07.921305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3abdc-cfde-44da-b897-dcbda058defe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:07.929361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:07.940346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-6ee3abdc-cfde-44da-b897-dcbda058defe None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:07.941540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6ee3abdc-cfde-44da-b897-dcbda058defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:08.001563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1274/2541] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:08.009271 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b2c46-cbdb-48f2-b9f8-14c098680dd6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:08.009563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b2c46-cbdb-48f2-b9f8-14c098680dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:08.009849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b2c46-cbdb-48f2-b9f8-14c098680dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:08.030746 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-629b2c46-cbdb-48f2-b9f8-14c098680dd6 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:08.032085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-629b2c46-cbdb-48f2-b9f8-14c098680dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:08.040136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1268/2542] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:08.044384 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3abdc-cfde-44da-b897-dcbda058defe None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:08.054119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3abdc-cfde-44da-b897-dcbda058defe None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:08.059186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f166046-a6d7-4a0f-ad04-fde996b4d697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:08.059876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f166046-a6d7-4a0f-ad04-fde996b4d697 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:08.060162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f166046-a6d7-4a0f-ad04-fde996b4d697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:08.060444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f166046-a6d7-4a0f-ad04-fde996b4d697 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:08.061171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f166046-a6d7-4a0f-ad04-fde996b4d697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:19:08.061531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f166046-a6d7-4a0f-ad04-fde996b4d697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:08.063124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f166046-a6d7-4a0f-ad04-fde996b4d697 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:08.075413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1275/2543] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:19:08.079660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b2c46-cbdb-48f2-b9f8-14c098680dd6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:08.088768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b2c46-cbdb-48f2-b9f8-14c098680dd6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:08.094134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c2877-643b-4e86-ae67-0a81a3680e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:08.094783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c2877-643b-4e86-ae67-0a81a3680e6a admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:08.095068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c2877-643b-4e86-ae67-0a81a3680e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:08.095344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c2877-643b-4e86-ae67-0a81a3680e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:08.096101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c2877-643b-4e86-ae67-0a81a3680e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:08.098061 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c2877-643b-4e86-ae67-0a81a3680e6a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:08.208476 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1269/2544] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:08 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:08.214099 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f166046-a6d7-4a0f-ad04-fde996b4d697 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:08.224315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f166046-a6d7-4a0f-ad04-fde996b4d697 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:08.241641 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c2877-643b-4e86-ae67-0a81a3680e6a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:08.243339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-aa5c2877-643b-4e86-ae67-0a81a3680e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:08.263465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:08.288651 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4e744-8915-4b68-8e0f-1cd764055b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:08.289311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e744-8915-4b68-8e0f-1cd764055b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:08.289594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e744-8915-4b68-8e0f-1cd764055b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:08.289870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e744-8915-4b68-8e0f-1cd764055b3f admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:08.290609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4e744-8915-4b68-8e0f-1cd764055b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:08.292594 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4e744-8915-4b68-8e0f-1cd764055b3f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:08.304326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c2877-643b-4e86-ae67-0a81a3680e6a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:08.308012 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b35f81-adc6-49fb-a3a7-a05d4eaa6fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:08.308745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b35f81-adc6-49fb-a3a7-a05d4eaa6fef service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:08.309031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b35f81-adc6-49fb-a3a7-a05d4eaa6fef service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:08.309308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b35f81-adc6-49fb-a3a7-a05d4eaa6fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:08.311297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-45b35f81-adc6-49fb-a3a7-a05d4eaa6fef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:08.325133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b35f81-adc6-49fb-a3a7-a05d4eaa6fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:08.326709 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b35f81-adc6-49fb-a3a7-a05d4eaa6fef service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:08.340785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1270/2545] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:19:08.371654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1276/2546] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:08 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:08.376038 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b35f81-adc6-49fb-a3a7-a05d4eaa6fef service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:08.388527 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b35f81-adc6-49fb-a3a7-a05d4eaa6fef service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:08.394787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430904d-d810-4d07-be64-c4324dc8a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:08.396187 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430904d-d810-4d07-be64-c4324dc8a2fd admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:08.396312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430904d-d810-4d07-be64-c4324dc8a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:08.396555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430904d-d810-4d07-be64-c4324dc8a2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:08.397295 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430904d-d810-4d07-be64-c4324dc8a2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:08.399062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430904d-d810-4d07-be64-c4324dc8a2fd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:08.412053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1271/2547] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:08.416122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4e744-8915-4b68-8e0f-1cd764055b3f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:08.426646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4e744-8915-4b68-8e0f-1cd764055b3f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:08.431315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28048700-5f12-4a9c-90b0-e2907414f887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:08.431999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28048700-5f12-4a9c-90b0-e2907414f887 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:08.432283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28048700-5f12-4a9c-90b0-e2907414f887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:08.432559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28048700-5f12-4a9c-90b0-e2907414f887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:08.433280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28048700-5f12-4a9c-90b0-e2907414f887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:08.434949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28048700-5f12-4a9c-90b0-e2907414f887 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:08.446193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1277/2548] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:08.451617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430904d-d810-4d07-be64-c4324dc8a2fd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:08.461884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430904d-d810-4d07-be64-c4324dc8a2fd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:08.467572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84f1ca-338f-463d-b537-850fb208c2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:08.468514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84f1ca-338f-463d-b537-850fb208c2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:08.468799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84f1ca-338f-463d-b537-850fb208c2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:08.469084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84f1ca-338f-463d-b537-850fb208c2f1 admin admin] PATH_INFO: `/v3/projects/85d638e9835541b89ce56ac0ab7757bd/users/3f3bd4e829964a7db1a3037f8da9cd48/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:08.485755 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84f1ca-338f-463d-b537-850fb208c2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d638e9835541b89ce56ac0ab7757bd, user_id=3f3bd4e829964a7db1a3037f8da9cd48, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:08.489328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84f1ca-338f-463d-b537-850fb208c2f1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:08.555735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1272/2549] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:08 2022] PUT /identity/v3/projects/85d638e9835541b89ce56ac0ab7757bd/users/3f3bd4e829964a7db1a3037f8da9cd48/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:08.567013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a399f-e575-49f9-a404-29cb4d1d8c88 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:08.567128 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a399f-e575-49f9-a404-29cb4d1d8c88 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:08.567378 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a399f-e575-49f9-a404-29cb4d1d8c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:08.595437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-9d9a399f-e575-49f9-a404-29cb4d1d8c88 None None] MFA Rules not processed for user `3f3bd4e829964a7db1a3037f8da9cd48`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:08.596696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9d9a399f-e575-49f9-a404-29cb4d1d8c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:08.661514 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:08.665308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1278/2550] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:08.670288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84f1ca-338f-463d-b537-850fb208c2f1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:08.740099 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84f1ca-338f-463d-b537-850fb208c2f1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:08.745233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c78dcf-0c4f-48d8-a0fe-fa2c6e0e586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:08.745544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c78dcf-0c4f-48d8-a0fe-fa2c6e0e586f admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:08.745826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c78dcf-0c4f-48d8-a0fe-fa2c6e0e586f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:08.746675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c78dcf-0c4f-48d8-a0fe-fa2c6e0e586f admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:08.747569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c78dcf-0c4f-48d8-a0fe-fa2c6e0e586f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:08.749552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c78dcf-0c4f-48d8-a0fe-fa2c6e0e586f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:08.850828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1273/2551] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:08 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:08.855033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a399f-e575-49f9-a404-29cb4d1d8c88 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:08.867820 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a399f-e575-49f9-a404-29cb4d1d8c88 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:08.935434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98003a-8ca2-49ff-9bc3-2fb09ab92e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:08.936158 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98003a-8ca2-49ff-9bc3-2fb09ab92e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:08.936430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98003a-8ca2-49ff-9bc3-2fb09ab92e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:08.936710 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98003a-8ca2-49ff-9bc3-2fb09ab92e07 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:08.937403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98003a-8ca2-49ff-9bc3-2fb09ab92e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:08.939328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98003a-8ca2-49ff-9bc3-2fb09ab92e07 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:09.045810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1279/2552] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:08 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:09.049739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c78dcf-0c4f-48d8-a0fe-fa2c6e0e586f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:09.061359 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c78dcf-0c4f-48d8-a0fe-fa2c6e0e586f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:09.066033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf8ca7-a726-4bcb-9bbc-19de291d420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:09.066812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf8ca7-a726-4bcb-9bbc-19de291d420f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:09.067146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf8ca7-a726-4bcb-9bbc-19de291d420f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:09.067426 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf8ca7-a726-4bcb-9bbc-19de291d420f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:09.068180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf8ca7-a726-4bcb-9bbc-19de291d420f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:09.069800 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf8ca7-a726-4bcb-9bbc-19de291d420f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:09.080874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1274/2553] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:09.084962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98003a-8ca2-49ff-9bc3-2fb09ab92e07 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:09.095744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98003a-8ca2-49ff-9bc3-2fb09ab92e07 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:09.100599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530288b-9619-4cc3-a4d2-01c019e63567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:09.101262 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530288b-9619-4cc3-a4d2-01c019e63567 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:09.101551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530288b-9619-4cc3-a4d2-01c019e63567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:09.101831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530288b-9619-4cc3-a4d2-01c019e63567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:09.102567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530288b-9619-4cc3-a4d2-01c019e63567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:09.104292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530288b-9619-4cc3-a4d2-01c019e63567 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:09.115289 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1280/2554] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:09.119477 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf8ca7-a726-4bcb-9bbc-19de291d420f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:09.130184 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf8ca7-a726-4bcb-9bbc-19de291d420f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:09.134785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b092-4a46-4a66-a4b8-2e30c4b932af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:09.135696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b092-4a46-4a66-a4b8-2e30c4b932af admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:09.135987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b092-4a46-4a66-a4b8-2e30c4b932af admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:09.136263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b092-4a46-4a66-a4b8-2e30c4b932af admin admin] PATH_INFO: `/v3/projects/07c478edd3b8499a9f4cd30ac56e44ff/users/5b856515deaa468f851a8cef8a5e24cf/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:09.153327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8b092-4a46-4a66-a4b8-2e30c4b932af admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c478edd3b8499a9f4cd30ac56e44ff, user_id=5b856515deaa468f851a8cef8a5e24cf, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:09.156029 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8b092-4a46-4a66-a4b8-2e30c4b932af admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:09.251074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1275/2555] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:09 2022] PUT /identity/v3/projects/07c478edd3b8499a9f4cd30ac56e44ff/users/5b856515deaa468f851a8cef8a5e24cf/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:09.262716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2e264-7854-489d-a767-529909aaf5b3 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:09.263297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2e264-7854-489d-a767-529909aaf5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:09.263421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2e264-7854-489d-a767-529909aaf5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:09.292440 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-96d2e264-7854-489d-a767-529909aaf5b3 None None] MFA Rules not processed for user `5b856515deaa468f851a8cef8a5e24cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:09.293941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-96d2e264-7854-489d-a767-529909aaf5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:09.362509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1281/2556] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:09.367358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b092-4a46-4a66-a4b8-2e30c4b932af admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:09.405033 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:09.433165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b092-4a46-4a66-a4b8-2e30c4b932af admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:09.438537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cd998-139e-49e2-a0f3-a914e20a3509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:09.439209 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd998-139e-49e2-a0f3-a914e20a3509 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:09.439504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd998-139e-49e2-a0f3-a914e20a3509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:09.439821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd998-139e-49e2-a0f3-a914e20a3509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:09.440525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cd998-139e-49e2-a0f3-a914e20a3509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:09.442529 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cd998-139e-49e2-a0f3-a914e20a3509 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:09.541141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1276/2557] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:09 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:09.542792 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2e264-7854-489d-a767-529909aaf5b3 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:09.560214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2e264-7854-489d-a767-529909aaf5b3 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:09.656796 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ea824-ee47-45e1-83aa-70db70c7603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:09.657638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea824-ee47-45e1-83aa-70db70c7603c admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:09.658200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea824-ee47-45e1-83aa-70db70c7603c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:09.658489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ea824-ee47-45e1-83aa-70db70c7603c admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:09.659207 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ea824-ee47-45e1-83aa-70db70c7603c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:09.661239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ea824-ee47-45e1-83aa-70db70c7603c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:09.736586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:09.746888 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1282/2558] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:09 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:09.748322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cd998-139e-49e2-a0f3-a914e20a3509 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:09.758856 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cd998-139e-49e2-a0f3-a914e20a3509 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:09.764117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccbe22-ff08-40a4-a494-fb8e6e238f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:09.764810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccbe22-ff08-40a4-a494-fb8e6e238f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:09.765147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccbe22-ff08-40a4-a494-fb8e6e238f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:09.765433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccbe22-ff08-40a4-a494-fb8e6e238f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:09.767512 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccbe22-ff08-40a4-a494-fb8e6e238f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:09.773240 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccbe22-ff08-40a4-a494-fb8e6e238f1b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:09.781168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1277/2559] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:09.785228 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ea824-ee47-45e1-83aa-70db70c7603c admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:09.796929 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ea824-ee47-45e1-83aa-70db70c7603c admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:09.801615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5109fa7-295a-4f87-a873-51e64d5f1abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:09.803522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5109fa7-295a-4f87-a873-51e64d5f1abf admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:09.803522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5109fa7-295a-4f87-a873-51e64d5f1abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:09.803522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5109fa7-295a-4f87-a873-51e64d5f1abf admin admin] PATH_INFO: `/v3/projects/c4a3c6240ce94a858eb76e3440f42528/users/ed88f2946d5048fa90b9cb99e2704aeb/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:09.820609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5109fa7-295a-4f87-a873-51e64d5f1abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a3c6240ce94a858eb76e3440f42528, user_id=ed88f2946d5048fa90b9cb99e2704aeb, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:09.823451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5109fa7-295a-4f87-a873-51e64d5f1abf admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:09.908408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1283/2560] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:09 2022] PUT /identity/v3/projects/c4a3c6240ce94a858eb76e3440f42528/users/ed88f2946d5048fa90b9cb99e2704aeb/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:09.912625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccbe22-ff08-40a4-a494-fb8e6e238f1b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:09.923365 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccbe22-ff08-40a4-a494-fb8e6e238f1b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:09.981896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b1dbb-78db-4a13-9011-8ef228907575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:09.982609 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1dbb-78db-4a13-9011-8ef228907575 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:09.982895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1dbb-78db-4a13-9011-8ef228907575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:09.983176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1dbb-78db-4a13-9011-8ef228907575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:09.983948 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b1dbb-78db-4a13-9011-8ef228907575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:09.985637 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b1dbb-78db-4a13-9011-8ef228907575 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:09.999796 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1278/2561] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:10.001426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5109fa7-295a-4f87-a873-51e64d5f1abf admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:10.013431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5109fa7-295a-4f87-a873-51e64d5f1abf admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:10.019846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac3be-97e8-4cb6-8f45-a454d499592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:10.021376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac3be-97e8-4cb6-8f45-a454d499592e admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:10.021376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac3be-97e8-4cb6-8f45-a454d499592e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:10.021376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac3be-97e8-4cb6-8f45-a454d499592e admin admin] PATH_INFO: `/v3/projects/c4a3c6240ce94a858eb76e3440f42528/users/ed88f2946d5048fa90b9cb99e2704aeb/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:10.023309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ac3be-97e8-4cb6-8f45-a454d499592e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a3c6240ce94a858eb76e3440f42528, user_id=ed88f2946d5048fa90b9cb99e2704aeb, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:10.026119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ac3be-97e8-4cb6-8f45-a454d499592e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:10.044815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1284/2562] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:10 2022] PUT /identity/v3/projects/c4a3c6240ce94a858eb76e3440f42528/users/ed88f2946d5048fa90b9cb99e2704aeb/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:10.059547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976b134-709e-4e4b-ade7-8c6893845062 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:10.062164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976b134-709e-4e4b-ade7-8c6893845062 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:10.062164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976b134-709e-4e4b-ade7-8c6893845062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:10.113922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a976b134-709e-4e4b-ade7-8c6893845062 None None] MFA Rules not processed for user `ed88f2946d5048fa90b9cb99e2704aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:10.117216 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a976b134-709e-4e4b-ade7-8c6893845062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:10.207688 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1279/2563] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:10.221753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac3be-97e8-4cb6-8f45-a454d499592e admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:10.224701 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-bb0ac3be-97e8-4cb6-8f45-a454d499592e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:10.305530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac3be-97e8-4cb6-8f45-a454d499592e admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:10.310304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e045750-a810-4d78-80b4-e457db7b79cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:10.310967 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045750-a810-4d78-80b4-e457db7b79cb service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:10.311258 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045750-a810-4d78-80b4-e457db7b79cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:10.311544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e045750-a810-4d78-80b4-e457db7b79cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:10.374611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e045750-a810-4d78-80b4-e457db7b79cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:10.376188 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e045750-a810-4d78-80b4-e457db7b79cb service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:10.386343 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1285/2564] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:12.185673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976b134-709e-4e4b-ade7-8c6893845062 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:12.187702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a976b134-709e-4e4b-ade7-8c6893845062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:12.229657 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:12.268993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976b134-709e-4e4b-ade7-8c6893845062 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:12.274044 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afe4e4-b04d-4fe3-9a55-81af7a705274 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdf5c7049f8499b8a25c88fbf4cb795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:12.274700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afe4e4-b04d-4fe3-9a55-81af7a705274 service placement] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:12.275114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afe4e4-b04d-4fe3-9a55-81af7a705274 service placement] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:12.275268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afe4e4-b04d-4fe3-9a55-81af7a705274 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:12.277416 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-22afe4e4-b04d-4fe3-9a55-81af7a705274 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:12.283451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e045750-a810-4d78-80b4-e457db7b79cb service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:12.289525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afe4e4-b04d-4fe3-9a55-81af7a705274 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:12.291077 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afe4e4-b04d-4fe3-9a55-81af7a705274 service placement] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:12.292033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e045750-a810-4d78-80b4-e457db7b79cb service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:12.296528 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1035167-2e60-4cdd-8a3c-34a11b761885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:12.297175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1035167-2e60-4cdd-8a3c-34a11b761885 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:12.297462 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1035167-2e60-4cdd-8a3c-34a11b761885 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:12.297744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1035167-2e60-4cdd-8a3c-34a11b761885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:12.301883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1280/2565] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:12.354217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afe4e4-b04d-4fe3-9a55-81af7a705274 service placement] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:12.356325 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-22afe4e4-b04d-4fe3-9a55-81af7a705274 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:12.362497 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1035167-2e60-4cdd-8a3c-34a11b761885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:12.364300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1035167-2e60-4cdd-8a3c-34a11b761885 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:12.374795 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1286/2566] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:19:12.427923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afe4e4-b04d-4fe3-9a55-81af7a705274 service placement] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:12.432455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81c4ae-7269-4aa1-b66c-02b4651929e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:12.433321 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c4ae-7269-4aa1-b66c-02b4651929e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:12.434173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c4ae-7269-4aa1-b66c-02b4651929e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:12.434440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c4ae-7269-4aa1-b66c-02b4651929e5 admin admin] PATH_INFO: `/v3/users/c7704f30352a4b7b8b8ee9019d86f50a` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:12.435688 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81c4ae-7269-4aa1-b66c-02b4651929e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7704f30352a4b7b8b8ee9019d86f50a)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:12.437651 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81c4ae-7269-4aa1-b66c-02b4651929e5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:12.721705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4c81c4ae-7269-4aa1-b66c-02b4651929e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7704f30352a4b7b8b8ee9019d86f50a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:12.850026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4c81c4ae-7269-4aa1-b66c-02b4651929e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7704f30352a4b7b8b8ee9019d86f50a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:12.864480 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4c81c4ae-7269-4aa1-b66c-02b4651929e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7704f30352a4b7b8b8ee9019d86f50a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:12.865317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4c81c4ae-7269-4aa1-b66c-02b4651929e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7704f30352a4b7b8b8ee9019d86f50a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:12.866084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4c81c4ae-7269-4aa1-b66c-02b4651929e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7704f30352a4b7b8b8ee9019d86f50a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:12.886392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1281/2567] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:12 2022] DELETE /identity/v3/users/c7704f30352a4b7b8b8ee9019d86f50a => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:13.185347 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1035167-2e60-4cdd-8a3c-34a11b761885 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:13.198436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1035167-2e60-4cdd-8a3c-34a11b761885 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:13.215655 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:13.263846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:13.264705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:13.264992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:13.267452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] PATH_INFO: `/v3/projects/58e32be518cc42cd87453b955925c57e` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:13.267452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e32be518cc42cd87453b955925c57e)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:13.268805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:13.435913 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e32be518cc42cd87453b955925c57e', 'request_id': 'req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:13.506551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e32be518cc42cd87453b955925c57e', 'request_id': 'req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:13.514452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e32be518cc42cd87453b955925c57e', 'request_id': 'req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:13.526117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] The token cache is being invalidate because project 58e32be518cc42cd87453b955925c57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:13.526408 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:13.527082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7c79b2c5-6c46-45ab-82b0-923ce6544f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:13.528976 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1287/2568] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:13 2022] DELETE /identity/v3/projects/58e32be518cc42cd87453b955925c57e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:13.539266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8bc95-3c68-4915-8c23-b8a3e60ff153 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:13.539266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8bc95-3c68-4915-8c23-b8a3e60ff153 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:13.539266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8bc95-3c68-4915-8c23-b8a3e60ff153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:13.561229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6ae8bc95-3c68-4915-8c23-b8a3e60ff153 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:13.562662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6ae8bc95-3c68-4915-8c23-b8a3e60ff153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:13.597630 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:13.627417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1282/2569] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:13.634810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc30bc-5e14-47c8-95cc-511d3067bd41 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:13.635106 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc30bc-5e14-47c8-95cc-511d3067bd41 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:13.635571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc30bc-5e14-47c8-95cc-511d3067bd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:13.654965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-3acc30bc-5e14-47c8-95cc-511d3067bd41 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:13.656235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-3acc30bc-5e14-47c8-95cc-511d3067bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:13.664369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1288/2570] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:13.675276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8bc95-3c68-4915-8c23-b8a3e60ff153 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:13.685521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8bc95-3c68-4915-8c23-b8a3e60ff153 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:13.690188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201aecf7-2804-4f4c-9a02-0e644ff63d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:13.690864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201aecf7-2804-4f4c-9a02-0e644ff63d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:13.691209 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201aecf7-2804-4f4c-9a02-0e644ff63d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:13.691487 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201aecf7-2804-4f4c-9a02-0e644ff63d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:13.692251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201aecf7-2804-4f4c-9a02-0e644ff63d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:19:13.692566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201aecf7-2804-4f4c-9a02-0e644ff63d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:13.694168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201aecf7-2804-4f4c-9a02-0e644ff63d87 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:13.706449 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1283/2571] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:19:13.710820 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc30bc-5e14-47c8-95cc-511d3067bd41 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:13.720524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc30bc-5e14-47c8-95cc-511d3067bd41 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:13.725252 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43943c-a4ab-4c41-ba0b-e200a96e79b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:13.725927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43943c-a4ab-4c41-ba0b-e200a96e79b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:13.726206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43943c-a4ab-4c41-ba0b-e200a96e79b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:13.726482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43943c-a4ab-4c41-ba0b-e200a96e79b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:13.727169 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43943c-a4ab-4c41-ba0b-e200a96e79b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:13.729158 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43943c-a4ab-4c41-ba0b-e200a96e79b8 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:13.805768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1289/2572] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:13 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:13.810265 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201aecf7-2804-4f4c-9a02-0e644ff63d87 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:13.821995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201aecf7-2804-4f4c-9a02-0e644ff63d87 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:13.884693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64f903-ffeb-45b0-b331-a323ab78ca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:13.885372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64f903-ffeb-45b0-b331-a323ab78ca97 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:13.885667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64f903-ffeb-45b0-b331-a323ab78ca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:13.885951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64f903-ffeb-45b0-b331-a323ab78ca97 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:13.887880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64f903-ffeb-45b0-b331-a323ab78ca97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:13.890592 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64f903-ffeb-45b0-b331-a323ab78ca97 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:13.977068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1284/2573] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:13 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:13.980429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43943c-a4ab-4c41-ba0b-e200a96e79b8 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:13.991146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43943c-a4ab-4c41-ba0b-e200a96e79b8 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:13.996599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4bd8f-c453-46ba-a659-d4e6f69d4b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:13.997442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4bd8f-c453-46ba-a659-d4e6f69d4b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:13.997680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4bd8f-c453-46ba-a659-d4e6f69d4b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.000423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4bd8f-c453-46ba-a659-d4e6f69d4b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.000423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4bd8f-c453-46ba-a659-d4e6f69d4b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:14.000423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4bd8f-c453-46ba-a659-d4e6f69d4b0f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:14.011244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1290/2574] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:14.015661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64f903-ffeb-45b0-b331-a323ab78ca97 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:14.026252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64f903-ffeb-45b0-b331-a323ab78ca97 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:14.031148 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534bda3-1c2d-43f2-bfc9-a5f45b70dfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:14.031829 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534bda3-1c2d-43f2-bfc9-a5f45b70dfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:14.032113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534bda3-1c2d-43f2-bfc9-a5f45b70dfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.032392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534bda3-1c2d-43f2-bfc9-a5f45b70dfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.033557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534bda3-1c2d-43f2-bfc9-a5f45b70dfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:14.034851 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534bda3-1c2d-43f2-bfc9-a5f45b70dfc6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:14.038815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4bd8f-c453-46ba-a659-d4e6f69d4b0f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:14.040602 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-64f4bd8f-c453-46ba-a659-d4e6f69d4b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:14.049418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1285/2575] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:14.053101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534bda3-1c2d-43f2-bfc9-a5f45b70dfc6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:14.064772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534bda3-1c2d-43f2-bfc9-a5f45b70dfc6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:14.069534 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4553a-7c8b-4e6d-b882-145bc87c1554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:14.070407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4553a-7c8b-4e6d-b882-145bc87c1554 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:14.070699 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4553a-7c8b-4e6d-b882-145bc87c1554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.070981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4553a-7c8b-4e6d-b882-145bc87c1554 admin admin] PATH_INFO: `/v3/projects/da0819e3c21245399b7e6c6c2701f549/users/260788d48a39413ba6401398008429bd/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.086658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4553a-7c8b-4e6d-b882-145bc87c1554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0819e3c21245399b7e6c6c2701f549, user_id=260788d48a39413ba6401398008429bd, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:14.089363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4553a-7c8b-4e6d-b882-145bc87c1554 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:14.100855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4bd8f-c453-46ba-a659-d4e6f69d4b0f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:14.104543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01789b6d-64de-46ef-bfd0-9a82b7df9641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:14.105192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01789b6d-64de-46ef-bfd0-9a82b7df9641 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:14.106411 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01789b6d-64de-46ef-bfd0-9a82b7df9641 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.106824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01789b6d-64de-46ef-bfd0-9a82b7df9641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.108684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-01789b6d-64de-46ef-bfd0-9a82b7df9641 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:14.126565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:14.164807 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1286/2576] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:14 2022] PUT /identity/v3/projects/da0819e3c21245399b7e6c6c2701f549/users/260788d48a39413ba6401398008429bd/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:14.174201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01789b6d-64de-46ef-bfd0-9a82b7df9641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:14.176079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01789b6d-64de-46ef-bfd0-9a82b7df9641 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:14.176915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c83c4-79b2-4b2e-bdbe-545011f4c113 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:14.177215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c83c4-79b2-4b2e-bdbe-545011f4c113 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.177546 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c83c4-79b2-4b2e-bdbe-545011f4c113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.186954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1291/2577] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:19:14.205633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7f3c83c4-79b2-4b2e-bdbe-545011f4c113 None None] MFA Rules not processed for user `260788d48a39413ba6401398008429bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:14.206848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7f3c83c4-79b2-4b2e-bdbe-545011f4c113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:14.275089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1287/2578] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:14.280143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01789b6d-64de-46ef-bfd0-9a82b7df9641 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:14.290630 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01789b6d-64de-46ef-bfd0-9a82b7df9641 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:14.348876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9095a9-909e-4a88-82be-ce909baae435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:14.349560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9095a9-909e-4a88-82be-ce909baae435 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:14.349849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9095a9-909e-4a88-82be-ce909baae435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.350131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9095a9-909e-4a88-82be-ce909baae435 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.350828 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9095a9-909e-4a88-82be-ce909baae435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:14.352769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9095a9-909e-4a88-82be-ce909baae435 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:14.434849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1292/2579] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:14 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:14.438888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c83c4-79b2-4b2e-bdbe-545011f4c113 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:14.450312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c83c4-79b2-4b2e-bdbe-545011f4c113 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:14.454999 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:14.510003 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88493f03-aa99-469d-ad2f-ccfcec773060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:14.510678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88493f03-aa99-469d-ad2f-ccfcec773060 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:14.510967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88493f03-aa99-469d-ad2f-ccfcec773060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.511286 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88493f03-aa99-469d-ad2f-ccfcec773060 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.513100 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88493f03-aa99-469d-ad2f-ccfcec773060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:14.515092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88493f03-aa99-469d-ad2f-ccfcec773060 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:14.610485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1288/2580] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:14 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:14.614426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9095a9-909e-4a88-82be-ce909baae435 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:14.625307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9095a9-909e-4a88-82be-ce909baae435 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:14.630323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f2869-cd40-40b2-8353-1c35bb3a555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:14.630972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2869-cd40-40b2-8353-1c35bb3a555d admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:14.631257 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2869-cd40-40b2-8353-1c35bb3a555d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.631724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f2869-cd40-40b2-8353-1c35bb3a555d admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.632417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f2869-cd40-40b2-8353-1c35bb3a555d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:14.634084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f2869-cd40-40b2-8353-1c35bb3a555d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:14.645994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1293/2581] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:14.650232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88493f03-aa99-469d-ad2f-ccfcec773060 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:14.661724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88493f03-aa99-469d-ad2f-ccfcec773060 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:14.666757 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c721-c07b-4b5f-83e4-512afd18ec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:14.667830 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c721-c07b-4b5f-83e4-512afd18ec4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:14.668131 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c721-c07b-4b5f-83e4-512afd18ec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.668417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c721-c07b-4b5f-83e4-512afd18ec4d admin admin] PATH_INFO: `/v3/projects/34e10359c3af492dbdcb75c617ba62cd/users/ab6e616e7ba14f24bd9a5af261d87642/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.683980 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289c721-c07b-4b5f-83e4-512afd18ec4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e10359c3af492dbdcb75c617ba62cd, user_id=ab6e616e7ba14f24bd9a5af261d87642, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:14.686660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289c721-c07b-4b5f-83e4-512afd18ec4d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:14.775654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1289/2582] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:14 2022] PUT /identity/v3/projects/34e10359c3af492dbdcb75c617ba62cd/users/ab6e616e7ba14f24bd9a5af261d87642/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:14.779909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f2869-cd40-40b2-8353-1c35bb3a555d admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:14.789941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f2869-cd40-40b2-8353-1c35bb3a555d admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:14.853011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9893064-0505-4373-b3fb-269e34c06734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:14.853683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9893064-0505-4373-b3fb-269e34c06734 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:14.853973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9893064-0505-4373-b3fb-269e34c06734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.854261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9893064-0505-4373-b3fb-269e34c06734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.854989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9893064-0505-4373-b3fb-269e34c06734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:14.856654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9893064-0505-4373-b3fb-269e34c06734 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:14.867142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1294/2583] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:14.871491 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c721-c07b-4b5f-83e4-512afd18ec4d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:14.882802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c721-c07b-4b5f-83e4-512afd18ec4d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:14.887430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645e4e6-af89-484d-b51c-17d916dc1dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:14.889157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645e4e6-af89-484d-b51c-17d916dc1dea admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:14.889440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645e4e6-af89-484d-b51c-17d916dc1dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.889716 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645e4e6-af89-484d-b51c-17d916dc1dea admin admin] PATH_INFO: `/v3/projects/34e10359c3af492dbdcb75c617ba62cd/users/ab6e616e7ba14f24bd9a5af261d87642/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.891847 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645e4e6-af89-484d-b51c-17d916dc1dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=34e10359c3af492dbdcb75c617ba62cd, user_id=ab6e616e7ba14f24bd9a5af261d87642, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:14.894837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645e4e6-af89-484d-b51c-17d916dc1dea admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:14.905352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1290/2584] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:14 2022] PUT /identity/v3/projects/34e10359c3af492dbdcb75c617ba62cd/users/ab6e616e7ba14f24bd9a5af261d87642/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:14.918041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2870e-3ea2-4100-98b9-d150b6e5da9b None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:14.918339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2870e-3ea2-4100-98b9-d150b6e5da9b None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:14.918623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2870e-3ea2-4100-98b9-d150b6e5da9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:14.947834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-edd2870e-3ea2-4100-98b9-d150b6e5da9b None None] MFA Rules not processed for user `ab6e616e7ba14f24bd9a5af261d87642`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:14.949400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-edd2870e-3ea2-4100-98b9-d150b6e5da9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:14.961901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:15.019382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1295/2585] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:15.032366 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645e4e6-af89-484d-b51c-17d916dc1dea admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:15.034062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0645e4e6-af89-484d-b51c-17d916dc1dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:15.091910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645e4e6-af89-484d-b51c-17d916dc1dea admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:15.095545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcb0e2-a4d8-4165-b3e3-758b537decff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:15.096204 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb0e2-a4d8-4165-b3e3-758b537decff service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:15.096488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb0e2-a4d8-4165-b3e3-758b537decff service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:15.096764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcb0e2-a4d8-4165-b3e3-758b537decff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:15.106109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcb0e2-a4d8-4165-b3e3-758b537decff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:15.107661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcb0e2-a4d8-4165-b3e3-758b537decff service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:15.117351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1291/2586] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:15.349261 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2870e-3ea2-4100-98b9-d150b6e5da9b None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:15.359474 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2870e-3ea2-4100-98b9-d150b6e5da9b None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:15.363043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebd243-ec5e-401d-82c1-957f0b51ccc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:15.363701 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd243-ec5e-401d-82c1-957f0b51ccc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:15.363988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd243-ec5e-401d-82c1-957f0b51ccc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:15.364283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd243-ec5e-401d-82c1-957f0b51ccc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:15.420712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebd243-ec5e-401d-82c1-957f0b51ccc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:15.422071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebd243-ec5e-401d-82c1-957f0b51ccc1 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:15.431498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1296/2587] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:18.590614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcb0e2-a4d8-4165-b3e3-758b537decff service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:18.592687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a9fcb0e2-a4d8-4165-b3e3-758b537decff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:18.662173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcb0e2-a4d8-4165-b3e3-758b537decff service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:18.666843 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:18.667810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:18.668098 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:18.668380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] PATH_INFO: `/v3/users/351f01d7c18b49b2b8e358609b27e4d9` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:18.669735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=351f01d7c18b49b2b8e358609b27e4d9)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:18.671923 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:18.676781 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:18.851903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351f01d7c18b49b2b8e358609b27e4d9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:18.936046 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351f01d7c18b49b2b8e358609b27e4d9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:18.948710 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351f01d7c18b49b2b8e358609b27e4d9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:18.949344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351f01d7c18b49b2b8e358609b27e4d9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:18.949951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351f01d7c18b49b2b8e358609b27e4d9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:18.962257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1292/2588] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:18 2022] DELETE /identity/v3/users/351f01d7c18b49b2b8e358609b27e4d9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:18.967310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d86b-27d5-4e87-aced-2afa8bbd13ed None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:18.967881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d86b-27d5-4e87-aced-2afa8bbd13ed None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:18.967982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d86b-27d5-4e87-aced-2afa8bbd13ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:18.986035 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-9d18d86b-27d5-4e87-aced-2afa8bbd13ed None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:18.991755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9d18d86b-27d5-4e87-aced-2afa8bbd13ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:19.055332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1297/2589] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:19.067254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:19.068937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:19.070280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18d86b-27d5-4e87-aced-2afa8bbd13ed None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:19.072712 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9d18d86b-27d5-4e87-aced-2afa8bbd13ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:19.086176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e0589-8747-4e4a-8b9a-0c3e9b69b213 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:19.091073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:19.092353 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:19.092678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:19.092968 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] PATH_INFO: `/v3/users/3f3bd4e829964a7db1a3037f8da9cd48` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:19.094275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3bd4e829964a7db1a3037f8da9cd48)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:19.096201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:19.131844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:19.135542 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18d86b-27d5-4e87-aced-2afa8bbd13ed None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:19.139459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb13e0-cdd9-40a6-9121-4550bad71045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:19.140204 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb13e0-cdd9-40a6-9121-4550bad71045 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:19.140498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb13e0-cdd9-40a6-9121-4550bad71045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:19.140781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb13e0-cdd9-40a6-9121-4550bad71045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:19.150132 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb13e0-cdd9-40a6-9121-4550bad71045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:19.151697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb13e0-cdd9-40a6-9121-4550bad71045 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:19.161733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1298/2590] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:19.309649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3bd4e829964a7db1a3037f8da9cd48'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:19.393317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3bd4e829964a7db1a3037f8da9cd48'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:19.408302 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3bd4e829964a7db1a3037f8da9cd48'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:19.409181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3bd4e829964a7db1a3037f8da9cd48'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:19.409803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3bd4e829964a7db1a3037f8da9cd48'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:19.423367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1293/2591] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:19 2022] DELETE /identity/v3/users/3f3bd4e829964a7db1a3037f8da9cd48 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:19.427832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b87ee0-2c25-46d8-8fe6-321cae45699a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:19.428130 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b87ee0-2c25-46d8-8fe6-321cae45699a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:19.428416 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b87ee0-2c25-46d8-8fe6-321cae45699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:19.446283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-d8b87ee0-2c25-46d8-8fe6-321cae45699a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:19.447499 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d8b87ee0-2c25-46d8-8fe6-321cae45699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:19.512487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1299/2592] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:19.523089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:19.526996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:19.576947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b87ee0-2c25-46d8-8fe6-321cae45699a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:19.578464 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d8b87ee0-2c25-46d8-8fe6-321cae45699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:19.589741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15deb0-f058-4a94-8759-365bfe3d4a6f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:19.594969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bad06f-8536-41d1-8d6a-9129f87a4a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:19.595736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bad06f-8536-41d1-8d6a-9129f87a4a9a service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:19.596026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bad06f-8536-41d1-8d6a-9129f87a4a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:19.596315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bad06f-8536-41d1-8d6a-9129f87a4a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:19.605524 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b87ee0-2c25-46d8-8fe6-321cae45699a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:19.608634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bad06f-8536-41d1-8d6a-9129f87a4a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:19.610133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bad06f-8536-41d1-8d6a-9129f87a4a9a service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:19.610362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:19.611320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:19.611650 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:19.611932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] PATH_INFO: `/v3/projects/8e424a68c809469289da9199019c10db` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:19.613159 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e424a68c809469289da9199019c10db)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:19.614284 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:19.615112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:19.620759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1294/2593] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:19.730836 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e424a68c809469289da9199019c10db', 'request_id': 'req-9802315e-4f6e-437e-bde2-72f99787214b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:19.803897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e424a68c809469289da9199019c10db', 'request_id': 'req-9802315e-4f6e-437e-bde2-72f99787214b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:19.810889 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e424a68c809469289da9199019c10db', 'request_id': 'req-9802315e-4f6e-437e-bde2-72f99787214b'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:19.821937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] The token cache is being invalidate because project 8e424a68c809469289da9199019c10db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:19.822228 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:19.822987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:19.824879 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1300/2594] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:19 2022] DELETE /identity/v3/projects/8e424a68c809469289da9199019c10db => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:20.092132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bad06f-8536-41d1-8d6a-9129f87a4a9a service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:20.093797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e7bad06f-8536-41d1-8d6a-9129f87a4a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:20.115844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bad06f-8536-41d1-8d6a-9129f87a4a9a service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:20.185558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:20.185558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:20.185558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:20.185558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] PATH_INFO: `/v3/projects/85d638e9835541b89ce56ac0ab7757bd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:20.186458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d638e9835541b89ce56ac0ab7757bd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:20.188505 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:20.301864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d638e9835541b89ce56ac0ab7757bd', 'request_id': 'req-1d5f1518-b176-47f3-a2ec-f130e4442547'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:20.308374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d638e9835541b89ce56ac0ab7757bd', 'request_id': 'req-1d5f1518-b176-47f3-a2ec-f130e4442547'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:20.316014 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d638e9835541b89ce56ac0ab7757bd', 'request_id': 'req-1d5f1518-b176-47f3-a2ec-f130e4442547'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:20.398324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] The token cache is being invalidate because project 85d638e9835541b89ce56ac0ab7757bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:20.398614 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:20.399253 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:20.400828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1295/2595] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:20 2022] DELETE /identity/v3/projects/85d638e9835541b89ce56ac0ab7757bd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:20.404819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:20.406241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:20.426340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802315e-4f6e-437e-bde2-72f99787214b admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:20.480298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:20.481166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:20.481448 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:20.481724 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] PATH_INFO: `/v3/users/5b856515deaa468f851a8cef8a5e24cf` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:20.483548 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b856515deaa468f851a8cef8a5e24cf)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:20.485503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:20.501208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:20.713948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b856515deaa468f851a8cef8a5e24cf'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:20.726129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b856515deaa468f851a8cef8a5e24cf'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:20.726807 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b856515deaa468f851a8cef8a5e24cf'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:20.734229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b856515deaa468f851a8cef8a5e24cf'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:20.734872 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b856515deaa468f851a8cef8a5e24cf'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:20.803211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1301/2596] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:20 2022] DELETE /identity/v3/users/5b856515deaa468f851a8cef8a5e24cf => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:21.178608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:21.180097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:21.198518 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1518-b176-47f3-a2ec-f130e4442547 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:21.275142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:21.275142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:21.275142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:21.275142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] PATH_INFO: `/v3/projects/07c478edd3b8499a9f4cd30ac56e44ff` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:21.275540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c478edd3b8499a9f4cd30ac56e44ff)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:21.275540 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:21.362805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:21.375215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c478edd3b8499a9f4cd30ac56e44ff', 'request_id': 'req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:21.380788 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c478edd3b8499a9f4cd30ac56e44ff', 'request_id': 'req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:21.386891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c478edd3b8499a9f4cd30ac56e44ff', 'request_id': 'req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:21.489251 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] The token cache is being invalidate because project 07c478edd3b8499a9f4cd30ac56e44ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:21.489537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:21.490152 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:21.491718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1296/2597] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:21 2022] DELETE /identity/v3/projects/07c478edd3b8499a9f4cd30ac56e44ff => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:21.495750 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:21.497153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:21.517403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1a18a-0d5e-4e78-b154-68108747d7b9 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:21.568179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927a849-d66b-4044-8a03-42c45c8dfe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:21.569102 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927a849-d66b-4044-8a03-42c45c8dfe75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:21.569413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927a849-d66b-4044-8a03-42c45c8dfe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:21.569685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927a849-d66b-4044-8a03-42c45c8dfe75 admin admin] PATH_INFO: `/v3/users/ed88f2946d5048fa90b9cb99e2704aeb` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:21.570882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927a849-d66b-4044-8a03-42c45c8dfe75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed88f2946d5048fa90b9cb99e2704aeb)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:21.572817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927a849-d66b-4044-8a03-42c45c8dfe75 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:21.703849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0927a849-d66b-4044-8a03-42c45c8dfe75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed88f2946d5048fa90b9cb99e2704aeb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:21.716953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0927a849-d66b-4044-8a03-42c45c8dfe75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed88f2946d5048fa90b9cb99e2704aeb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:21.717619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0927a849-d66b-4044-8a03-42c45c8dfe75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed88f2946d5048fa90b9cb99e2704aeb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:21.725782 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0927a849-d66b-4044-8a03-42c45c8dfe75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed88f2946d5048fa90b9cb99e2704aeb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:21.726411 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0927a849-d66b-4044-8a03-42c45c8dfe75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed88f2946d5048fa90b9cb99e2704aeb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:21.792255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1302/2598] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:21 2022] DELETE /identity/v3/users/ed88f2946d5048fa90b9cb99e2704aeb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:22.199986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:22.201450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:22.216794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdf3fa-ead1-4aa8-b9c4-66f6072e5e8a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:22.276183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:22.277200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:22.277357 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:22.277725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] PATH_INFO: `/v3/projects/c4a3c6240ce94a858eb76e3440f42528` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:22.278806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a3c6240ce94a858eb76e3440f42528)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:22.280724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:22.388415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a3c6240ce94a858eb76e3440f42528', 'request_id': 'req-d435523f-1b99-4a2c-b70b-d5344f2fc675'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:22.395034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a3c6240ce94a858eb76e3440f42528', 'request_id': 'req-d435523f-1b99-4a2c-b70b-d5344f2fc675'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:22.401341 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a3c6240ce94a858eb76e3440f42528', 'request_id': 'req-d435523f-1b99-4a2c-b70b-d5344f2fc675'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:22.472744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] The token cache is being invalidate because project c4a3c6240ce94a858eb76e3440f42528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:22.473042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:22.473786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d435523f-1b99-4a2c-b70b-d5344f2fc675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:22.475352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1297/2599] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:22 2022] DELETE /identity/v3/projects/c4a3c6240ce94a858eb76e3440f42528 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:22.480584 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd3d99-4270-4ef4-b5d1-97ca9ee6184e None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:22.480877 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd3d99-4270-4ef4-b5d1-97ca9ee6184e None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:22.481337 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd3d99-4270-4ef4-b5d1-97ca9ee6184e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:22.499196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c4bd3d99-4270-4ef4-b5d1-97ca9ee6184e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:22.500421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c4bd3d99-4270-4ef4-b5d1-97ca9ee6184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:22.509590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:22.564113 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1303/2600] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:22.571982 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562d011-e8b6-4f8a-a790-d061fa98d60d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:22.572279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562d011-e8b6-4f8a-a790-d061fa98d60d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:22.572560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562d011-e8b6-4f8a-a790-d061fa98d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:22.591825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c562d011-e8b6-4f8a-a790-d061fa98d60d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:22.593026 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c562d011-e8b6-4f8a-a790-d061fa98d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:22.601551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1298/2601] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:22.605972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd3d99-4270-4ef4-b5d1-97ca9ee6184e None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:22.615988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd3d99-4270-4ef4-b5d1-97ca9ee6184e None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:22.620680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1caf22-380c-427e-b6d0-b81ced474ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:22.621330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1caf22-380c-427e-b6d0-b81ced474ccd admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:22.621614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1caf22-380c-427e-b6d0-b81ced474ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:22.621891 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1caf22-380c-427e-b6d0-b81ced474ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:22.622619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1caf22-380c-427e-b6d0-b81ced474ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:19:22.622963 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1caf22-380c-427e-b6d0-b81ced474ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:22.624616 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1caf22-380c-427e-b6d0-b81ced474ccd admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:22.636212 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1304/2602] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:19:22.640557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562d011-e8b6-4f8a-a790-d061fa98d60d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:22.651276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562d011-e8b6-4f8a-a790-d061fa98d60d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:22.656166 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fa0c5-989e-45cd-af67-15eb53c4c70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:22.656820 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fa0c5-989e-45cd-af67-15eb53c4c70f admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:22.657110 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fa0c5-989e-45cd-af67-15eb53c4c70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:22.657392 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27fa0c5-989e-45cd-af67-15eb53c4c70f admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:22.658119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fa0c5-989e-45cd-af67-15eb53c4c70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:22.660669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27fa0c5-989e-45cd-af67-15eb53c4c70f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:22.764610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1299/2603] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:22 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:22.765720 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1caf22-380c-427e-b6d0-b81ced474ccd admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:22.777180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1caf22-380c-427e-b6d0-b81ced474ccd admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:22.834577 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6a54e-6f68-4ecd-9ae1-b7871382ca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:22.835191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a54e-6f68-4ecd-9ae1-b7871382ca39 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:22.835479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a54e-6f68-4ecd-9ae1-b7871382ca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:22.835788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a54e-6f68-4ecd-9ae1-b7871382ca39 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:22.836516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6a54e-6f68-4ecd-9ae1-b7871382ca39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:22.838433 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6a54e-6f68-4ecd-9ae1-b7871382ca39 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:22.935816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1305/2604] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:22 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:22.939880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fa0c5-989e-45cd-af67-15eb53c4c70f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:22.951059 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27fa0c5-989e-45cd-af67-15eb53c4c70f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:22.956335 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada4506-4bda-4928-b0f9-027183d5e2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:22.957142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada4506-4bda-4928-b0f9-027183d5e2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:22.957442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada4506-4bda-4928-b0f9-027183d5e2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:22.957750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada4506-4bda-4928-b0f9-027183d5e2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:22.958503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada4506-4bda-4928-b0f9-027183d5e2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:22.960123 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada4506-4bda-4928-b0f9-027183d5e2e9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:22.971202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1300/2605] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:22.976239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6a54e-6f68-4ecd-9ae1-b7871382ca39 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:22.986466 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6a54e-6f68-4ecd-9ae1-b7871382ca39 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:22.991668 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf5600-1e65-4abe-be13-62b2f66e597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:22.992329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf5600-1e65-4abe-be13-62b2f66e597e admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:22.992647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf5600-1e65-4abe-be13-62b2f66e597e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:22.992934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf5600-1e65-4abe-be13-62b2f66e597e admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:22.993674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf5600-1e65-4abe-be13-62b2f66e597e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:22.995311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf5600-1e65-4abe-be13-62b2f66e597e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:23.006603 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1306/2606] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:23.010940 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada4506-4bda-4928-b0f9-027183d5e2e9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:23.022784 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada4506-4bda-4928-b0f9-027183d5e2e9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:23.027727 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b6ee6-ee9e-4c31-937e-9e86b9feb382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:23.028638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b6ee6-ee9e-4c31-937e-9e86b9feb382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:23.028925 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b6ee6-ee9e-4c31-937e-9e86b9feb382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:23.029202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b6ee6-ee9e-4c31-937e-9e86b9feb382 admin admin] PATH_INFO: `/v3/projects/683c7472bf3544d0917b7167f5e70ac0/users/3032b8b71f994330a23fef02055446f0/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:23.032541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:23.044533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b6ee6-ee9e-4c31-937e-9e86b9feb382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683c7472bf3544d0917b7167f5e70ac0, user_id=3032b8b71f994330a23fef02055446f0, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:23.047279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b6ee6-ee9e-4c31-937e-9e86b9feb382 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:23.124409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1301/2607] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:23 2022] PUT /identity/v3/projects/683c7472bf3544d0917b7167f5e70ac0/users/3032b8b71f994330a23fef02055446f0/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:23.135689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc368c-a871-43df-9da4-2e70e2034a71 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:23.135988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc368c-a871-43df-9da4-2e70e2034a71 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:23.136279 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bc368c-a871-43df-9da4-2e70e2034a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:23.163591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-d7bc368c-a871-43df-9da4-2e70e2034a71 None None] MFA Rules not processed for user `3032b8b71f994330a23fef02055446f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:23.164835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d7bc368c-a871-43df-9da4-2e70e2034a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:23.229355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1307/2608] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:23.241787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b6ee6-ee9e-4c31-937e-9e86b9feb382 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:23.243717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-894b6ee6-ee9e-4c31-937e-9e86b9feb382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:23.301877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b6ee6-ee9e-4c31-937e-9e86b9feb382 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:23.305748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91338be-bb32-4055-b5b7-86b0c0e4b659 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d089c711a94b70a198e35443ee7ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:23.306390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91338be-bb32-4055-b5b7-86b0c0e4b659 service glance] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:23.306680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91338be-bb32-4055-b5b7-86b0c0e4b659 service glance] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:23.306962 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91338be-bb32-4055-b5b7-86b0c0e4b659 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:23.315236 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91338be-bb32-4055-b5b7-86b0c0e4b659 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:23.316794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91338be-bb32-4055-b5b7-86b0c0e4b659 service glance] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:23.326404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1302/2609] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:19:33.226552 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:33.322169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:39.344295 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc368c-a871-43df-9da4-2e70e2034a71 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:39.345768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d7bc368c-a871-43df-9da4-2e70e2034a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:39.404894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bc368c-a871-43df-9da4-2e70e2034a71 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:39.408452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc5012-8250-4417-806e-15158deccccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:39.409114 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc5012-8250-4417-806e-15158deccccf service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:39.409393 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc5012-8250-4417-806e-15158deccccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:39.409667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc5012-8250-4417-806e-15158deccccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:39.411427 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1fbc5012-8250-4417-806e-15158deccccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:39.475924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc5012-8250-4417-806e-15158deccccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:39.477476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc5012-8250-4417-806e-15158deccccf service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:39.487410 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1308/2610] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:43.114451 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91338be-bb32-4055-b5b7-86b0c0e4b659 service glance] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:43.116901 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b91338be-bb32-4055-b5b7-86b0c0e4b659 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:43.132667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91338be-bb32-4055-b5b7-86b0c0e4b659 service glance] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:43.137951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d81524-5bfe-4de6-87b7-c27cac237ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:43.140862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81524-5bfe-4de6-87b7-c27cac237ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:43.140862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81524-5bfe-4de6-87b7-c27cac237ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:43.140862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d81524-5bfe-4de6-87b7-c27cac237ca1 admin admin] PATH_INFO: `/v3/users/0439579b269b4fdd927ce404937ba204` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:43.141419 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d81524-5bfe-4de6-87b7-c27cac237ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0439579b269b4fdd927ce404937ba204)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:43.143678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d81524-5bfe-4de6-87b7-c27cac237ca1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:43.376382 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-19d81524-5bfe-4de6-87b7-c27cac237ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0439579b269b4fdd927ce404937ba204'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.466753 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-19d81524-5bfe-4de6-87b7-c27cac237ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0439579b269b4fdd927ce404937ba204'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.481567 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-19d81524-5bfe-4de6-87b7-c27cac237ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0439579b269b4fdd927ce404937ba204'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.482486 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-19d81524-5bfe-4de6-87b7-c27cac237ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0439579b269b4fdd927ce404937ba204'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.483416 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-19d81524-5bfe-4de6-87b7-c27cac237ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0439579b269b4fdd927ce404937ba204'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.498275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1303/2611] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:43 2022] DELETE /identity/v3/users/0439579b269b4fdd927ce404937ba204 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:43.747675 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc5012-8250-4417-806e-15158deccccf service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:43.758672 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc5012-8250-4417-806e-15158deccccf service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:43.820085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:43.820999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:43.821284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:43.821561 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] PATH_INFO: `/v3/projects/114a51f6b82c468bb5b9fcbc842146cd` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:43.822738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] RBAC: Authorizing `identity:delete_project(project_id=114a51f6b82c468bb5b9fcbc842146cd)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:43.824697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:43.947817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114a51f6b82c468bb5b9fcbc842146cd', 'request_id': 'req-428e2794-a55e-49ca-97f3-46f80d2aedef'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:43.950295 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:44.016082 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114a51f6b82c468bb5b9fcbc842146cd', 'request_id': 'req-428e2794-a55e-49ca-97f3-46f80d2aedef'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:44.024164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114a51f6b82c468bb5b9fcbc842146cd', 'request_id': 'req-428e2794-a55e-49ca-97f3-46f80d2aedef'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:44.034435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] The token cache is being invalidate because project 114a51f6b82c468bb5b9fcbc842146cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:44.034962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:44.035753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-428e2794-a55e-49ca-97f3-46f80d2aedef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:44.037368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1309/2612] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:43 2022] DELETE /identity/v3/projects/114a51f6b82c468bb5b9fcbc842146cd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:44.042568 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078c1ce-e61c-45c5-8947-577bbc9f23a2 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:44.042859 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078c1ce-e61c-45c5-8947-577bbc9f23a2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:44.043136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078c1ce-e61c-45c5-8947-577bbc9f23a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:44.060640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3078c1ce-e61c-45c5-8947-577bbc9f23a2 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:44.061860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3078c1ce-e61c-45c5-8947-577bbc9f23a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:44.135030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1304/2613] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:44.142740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de9d1-5b3c-4fee-9029-085b10569ca3 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:44.143031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de9d1-5b3c-4fee-9029-085b10569ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:44.143315 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41de9d1-5b3c-4fee-9029-085b10569ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:44.162235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-d41de9d1-5b3c-4fee-9029-085b10569ca3 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:44.163425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d41de9d1-5b3c-4fee-9029-085b10569ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:44.171328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1310/2614] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:44.175733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078c1ce-e61c-45c5-8947-577bbc9f23a2 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:44.186427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078c1ce-e61c-45c5-8947-577bbc9f23a2 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:44.191233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501a6d0-881a-4161-a64a-8ca8968eeef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:44.192496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501a6d0-881a-4161-a64a-8ca8968eeef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:44.192787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501a6d0-881a-4161-a64a-8ca8968eeef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:44.193150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501a6d0-881a-4161-a64a-8ca8968eeef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:44.193918 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501a6d0-881a-4161-a64a-8ca8968eeef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:19:44.194235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501a6d0-881a-4161-a64a-8ca8968eeef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:44.200037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501a6d0-881a-4161-a64a-8ca8968eeef0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:44.208324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1305/2615] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:19:44.212925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41de9d1-5b3c-4fee-9029-085b10569ca3 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:44.224104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41de9d1-5b3c-4fee-9029-085b10569ca3 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:44.228928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fabac4-1200-4198-9bbc-7df5ccee4922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:44.229567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fabac4-1200-4198-9bbc-7df5ccee4922 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:44.229900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fabac4-1200-4198-9bbc-7df5ccee4922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:44.230217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fabac4-1200-4198-9bbc-7df5ccee4922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:44.230938 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fabac4-1200-4198-9bbc-7df5ccee4922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:44.232944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fabac4-1200-4198-9bbc-7df5ccee4922 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:44.375198 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1311/2616] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:44 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:44.378255 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501a6d0-881a-4161-a64a-8ca8968eeef0 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:44.396092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501a6d0-881a-4161-a64a-8ca8968eeef0 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:44.450656 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a61197-5ff0-4b92-8178-7ad545988c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:44.451235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61197-5ff0-4b92-8178-7ad545988c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:44.451516 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61197-5ff0-4b92-8178-7ad545988c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:44.451822 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a61197-5ff0-4b92-8178-7ad545988c0b admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:44.452509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a61197-5ff0-4b92-8178-7ad545988c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:44.454467 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a61197-5ff0-4b92-8178-7ad545988c0b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:44.461224 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:44.558427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1306/2617] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:44 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:44.562597 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fabac4-1200-4198-9bbc-7df5ccee4922 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:44.580638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fabac4-1200-4198-9bbc-7df5ccee4922 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:44.586105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f6912-c19b-4405-98fa-198d1e8028ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:44.589330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f6912-c19b-4405-98fa-198d1e8028ce admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:44.589330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f6912-c19b-4405-98fa-198d1e8028ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:44.589330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f6912-c19b-4405-98fa-198d1e8028ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:44.589330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f6912-c19b-4405-98fa-198d1e8028ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:44.594884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f6912-c19b-4405-98fa-198d1e8028ce admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:44.607451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1312/2618] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:44.611399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a61197-5ff0-4b92-8178-7ad545988c0b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:44.625837 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a61197-5ff0-4b92-8178-7ad545988c0b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:44.630687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746af0ac-b624-4317-bd32-8bc0647d3027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:44.631338 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af0ac-b624-4317-bd32-8bc0647d3027 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:44.631676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af0ac-b624-4317-bd32-8bc0647d3027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:44.631960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af0ac-b624-4317-bd32-8bc0647d3027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:44.632680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746af0ac-b624-4317-bd32-8bc0647d3027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:44.634270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746af0ac-b624-4317-bd32-8bc0647d3027 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:44.645514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1307/2619] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:44.649781 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f6912-c19b-4405-98fa-198d1e8028ce admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:44.659719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f6912-c19b-4405-98fa-198d1e8028ce admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:44.665341 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e4e65-b312-470e-a93c-791dc9f1a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:44.666708 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e4e65-b312-470e-a93c-791dc9f1a07e admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:44.666997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e4e65-b312-470e-a93c-791dc9f1a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:44.667276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e4e65-b312-470e-a93c-791dc9f1a07e admin admin] PATH_INFO: `/v3/projects/b51ec606eef243debf2f55fb17bb7d8c/users/269b10aff78743c4a6c55e0b62fe2cd7/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:44.683054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e4e65-b312-470e-a93c-791dc9f1a07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51ec606eef243debf2f55fb17bb7d8c, user_id=269b10aff78743c4a6c55e0b62fe2cd7, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:44.685826 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e4e65-b312-470e-a93c-791dc9f1a07e admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:44.771490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1313/2620] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:44 2022] PUT /identity/v3/projects/b51ec606eef243debf2f55fb17bb7d8c/users/269b10aff78743c4a6c55e0b62fe2cd7/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:44.781578 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792b434-4f1e-41ad-887a-6b9ff4144b5d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:44.781869 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792b434-4f1e-41ad-887a-6b9ff4144b5d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:44.782146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792b434-4f1e-41ad-887a-6b9ff4144b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:44.809127 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8792b434-4f1e-41ad-887a-6b9ff4144b5d None None] MFA Rules not processed for user `269b10aff78743c4a6c55e0b62fe2cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:44.810330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8792b434-4f1e-41ad-887a-6b9ff4144b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:44.877170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1308/2621] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:44.881959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e4e65-b312-470e-a93c-791dc9f1a07e admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:44.944271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e4e65-b312-470e-a93c-791dc9f1a07e admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:44.949017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3fba8-31f8-4669-ab75-d0215c9cf94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:44.949673 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3fba8-31f8-4669-ab75-d0215c9cf94b admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:44.949969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3fba8-31f8-4669-ab75-d0215c9cf94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:44.950247 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee3fba8-31f8-4669-ab75-d0215c9cf94b admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:44.950947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3fba8-31f8-4669-ab75-d0215c9cf94b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:44.952874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee3fba8-31f8-4669-ab75-d0215c9cf94b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:45.073772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1314/2622] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:44 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:45.077791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792b434-4f1e-41ad-887a-6b9ff4144b5d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:45.089577 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792b434-4f1e-41ad-887a-6b9ff4144b5d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:45.148981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159d762-e2b4-4880-9dfc-ee5b3a496735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:45.149654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159d762-e2b4-4880-9dfc-ee5b3a496735 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:45.149935 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159d762-e2b4-4880-9dfc-ee5b3a496735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:45.150206 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159d762-e2b4-4880-9dfc-ee5b3a496735 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:45.150893 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159d762-e2b4-4880-9dfc-ee5b3a496735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:45.152812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159d762-e2b4-4880-9dfc-ee5b3a496735 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:45.284607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1309/2623] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:45 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:45.288777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3fba8-31f8-4669-ab75-d0215c9cf94b admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:45.298953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee3fba8-31f8-4669-ab75-d0215c9cf94b admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:45.303810 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24122aba-8a32-4fdd-8688-a74bab4bd22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:45.304470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122aba-8a32-4fdd-8688-a74bab4bd22b admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:45.304784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122aba-8a32-4fdd-8688-a74bab4bd22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:45.305066 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122aba-8a32-4fdd-8688-a74bab4bd22b admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:45.305795 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24122aba-8a32-4fdd-8688-a74bab4bd22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:45.307411 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24122aba-8a32-4fdd-8688-a74bab4bd22b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:45.318543 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1315/2624] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:45.325007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159d762-e2b4-4880-9dfc-ee5b3a496735 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:45.335544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159d762-e2b4-4880-9dfc-ee5b3a496735 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:45.340188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff04e3-c77f-4428-9850-863e77ef3a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:45.341050 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff04e3-c77f-4428-9850-863e77ef3a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:45.341332 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff04e3-c77f-4428-9850-863e77ef3a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:45.341878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff04e3-c77f-4428-9850-863e77ef3a9d admin admin] PATH_INFO: `/v3/projects/1e551f8bba574320a72935c7d4ee760b/users/e2cb3d282b7f4f83b1c2e2a60b9bea5a/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:45.360290 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff04e3-c77f-4428-9850-863e77ef3a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e551f8bba574320a72935c7d4ee760b, user_id=e2cb3d282b7f4f83b1c2e2a60b9bea5a, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:45.362991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff04e3-c77f-4428-9850-863e77ef3a9d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:45.478513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1310/2625] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:45 2022] PUT /identity/v3/projects/1e551f8bba574320a72935c7d4ee760b/users/e2cb3d282b7f4f83b1c2e2a60b9bea5a/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:45.482761 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24122aba-8a32-4fdd-8688-a74bab4bd22b admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:45.493203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24122aba-8a32-4fdd-8688-a74bab4bd22b admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:45.541081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:45.550684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43dd06-df8d-4933-a656-c09180d5fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:45.551454 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43dd06-df8d-4933-a656-c09180d5fa86 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:45.551768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43dd06-df8d-4933-a656-c09180d5fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:45.552056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43dd06-df8d-4933-a656-c09180d5fa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:45.552787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43dd06-df8d-4933-a656-c09180d5fa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:45.554392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43dd06-df8d-4933-a656-c09180d5fa86 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:45.564455 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1316/2626] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:45.569287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff04e3-c77f-4428-9850-863e77ef3a9d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:45.579466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff04e3-c77f-4428-9850-863e77ef3a9d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:45.584821 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303abe7-cbf3-4847-8f79-180c0c2a1a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:45.585749 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303abe7-cbf3-4847-8f79-180c0c2a1a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:45.586030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303abe7-cbf3-4847-8f79-180c0c2a1a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:45.586304 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303abe7-cbf3-4847-8f79-180c0c2a1a92 admin admin] PATH_INFO: `/v3/projects/1e551f8bba574320a72935c7d4ee760b/users/e2cb3d282b7f4f83b1c2e2a60b9bea5a/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:45.588283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303abe7-cbf3-4847-8f79-180c0c2a1a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e551f8bba574320a72935c7d4ee760b, user_id=e2cb3d282b7f4f83b1c2e2a60b9bea5a, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:45.590887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303abe7-cbf3-4847-8f79-180c0c2a1a92 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:45.601377 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1311/2627] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:45 2022] PUT /identity/v3/projects/1e551f8bba574320a72935c7d4ee760b/users/e2cb3d282b7f4f83b1c2e2a60b9bea5a/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:45.612842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438b6ab-643d-47c1-a98f-9209e8f925d2 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:45.613138 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438b6ab-643d-47c1-a98f-9209e8f925d2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:45.613446 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438b6ab-643d-47c1-a98f-9209e8f925d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:45.642673 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a438b6ab-643d-47c1-a98f-9209e8f925d2 None None] MFA Rules not processed for user `e2cb3d282b7f4f83b1c2e2a60b9bea5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:45.644228 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a438b6ab-643d-47c1-a98f-9209e8f925d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:45.713857 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1317/2628] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:45.725522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303abe7-cbf3-4847-8f79-180c0c2a1a92 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:45.727222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b303abe7-cbf3-4847-8f79-180c0c2a1a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:45.751330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:45.790654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303abe7-cbf3-4847-8f79-180c0c2a1a92 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:45.798244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e0260-4f14-4629-918c-1ea952698e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:45.798244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0260-4f14-4629-918c-1ea952698e09 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:45.798244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0260-4f14-4629-918c-1ea952698e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:45.798244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0260-4f14-4629-918c-1ea952698e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:45.805599 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e0260-4f14-4629-918c-1ea952698e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:45.807041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e0260-4f14-4629-918c-1ea952698e09 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:45.816626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1312/2629] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:45.994747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438b6ab-643d-47c1-a98f-9209e8f925d2 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:46.004962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438b6ab-643d-47c1-a98f-9209e8f925d2 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:46.008537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24985d11-20f8-4fcf-bddd-1bd7ac6c087e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:46.009747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24985d11-20f8-4fcf-bddd-1bd7ac6c087e service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:46.009747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24985d11-20f8-4fcf-bddd-1bd7ac6c087e service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:46.009747 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24985d11-20f8-4fcf-bddd-1bd7ac6c087e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:46.067717 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24985d11-20f8-4fcf-bddd-1bd7ac6c087e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:46.069192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24985d11-20f8-4fcf-bddd-1bd7ac6c087e service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:46.077990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1318/2630] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:19:50.468950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e0260-4f14-4629-918c-1ea952698e09 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:50.470118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cc0e0260-4f14-4629-918c-1ea952698e09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:50.545314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e0260-4f14-4629-918c-1ea952698e09 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:50.549929 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:50.550827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:50.551118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:50.551420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] PATH_INFO: `/v3/users/3032b8b71f994330a23fef02055446f0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:50.552650 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3032b8b71f994330a23fef02055446f0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:50.555220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:50.704071 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3032b8b71f994330a23fef02055446f0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:50.764002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3032b8b71f994330a23fef02055446f0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:50.777262 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3032b8b71f994330a23fef02055446f0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:50.777942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3032b8b71f994330a23fef02055446f0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:50.778552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3032b8b71f994330a23fef02055446f0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:50.795247 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1313/2631] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:50 2022] DELETE /identity/v3/users/3032b8b71f994330a23fef02055446f0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:50.798218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f642f40-bf32-4176-bae0-6ba7d42dcf29 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:50.798699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f642f40-bf32-4176-bae0-6ba7d42dcf29 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:50.798796 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f642f40-bf32-4176-bae0-6ba7d42dcf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:50.816506 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5f642f40-bf32-4176-bae0-6ba7d42dcf29 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:50.817713 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5f642f40-bf32-4176-bae0-6ba7d42dcf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:50.880526 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1319/2632] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:50.890314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:50.891765 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:50.940105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:50.951311 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d675d2-6ce7-4cdb-b7ad-37d21440ef26 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:50.956383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fb24f-67ca-4a32-b6e1-c07083f3bdcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:50.957037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb24f-67ca-4a32-b6e1-c07083f3bdcb service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:50.957334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb24f-67ca-4a32-b6e1-c07083f3bdcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:50.957616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fb24f-67ca-4a32-b6e1-c07083f3bdcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:50.967042 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fb24f-67ca-4a32-b6e1-c07083f3bdcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:50.968521 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fb24f-67ca-4a32-b6e1-c07083f3bdcb service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:50.978612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1314/2633] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:51.400876 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f642f40-bf32-4176-bae0-6ba7d42dcf29 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:51.402309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5f642f40-bf32-4176-bae0-6ba7d42dcf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:51.416142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f642f40-bf32-4176-bae0-6ba7d42dcf29 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:51.421085 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:51.421961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:51.422251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:51.422539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] PATH_INFO: `/v3/projects/683c7472bf3544d0917b7167f5e70ac0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:51.423780 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=683c7472bf3544d0917b7167f5e70ac0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:51.425959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:51.433270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:51.531402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683c7472bf3544d0917b7167f5e70ac0', 'request_id': 'req-2f984bdb-e705-4b33-8939-94afe5a0ec82'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:51.626827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683c7472bf3544d0917b7167f5e70ac0', 'request_id': 'req-2f984bdb-e705-4b33-8939-94afe5a0ec82'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:51.634545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683c7472bf3544d0917b7167f5e70ac0', 'request_id': 'req-2f984bdb-e705-4b33-8939-94afe5a0ec82'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:51.647313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] The token cache is being invalidate because project 683c7472bf3544d0917b7167f5e70ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:51.647634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:51.649055 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-2f984bdb-e705-4b33-8939-94afe5a0ec82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:51.653388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1320/2634] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:51 2022] DELETE /identity/v3/projects/683c7472bf3544d0917b7167f5e70ac0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:52.631927 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fb24f-67ca-4a32-b6e1-c07083f3bdcb service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:52.633767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b12fb24f-67ca-4a32-b6e1-c07083f3bdcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:52.647239 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fb24f-67ca-4a32-b6e1-c07083f3bdcb service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:52.714763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:52.715876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:52.716293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:52.716663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] PATH_INFO: `/v3/users/260788d48a39413ba6401398008429bd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:52.718530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=260788d48a39413ba6401398008429bd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:52.720215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:52.927658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260788d48a39413ba6401398008429bd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:53.004141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260788d48a39413ba6401398008429bd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:53.021715 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260788d48a39413ba6401398008429bd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:53.021715 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260788d48a39413ba6401398008429bd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:53.021715 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260788d48a39413ba6401398008429bd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:53.041704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1315/2635] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:52 2022] DELETE /identity/v3/users/260788d48a39413ba6401398008429bd => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:53.042508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d44b-c4e9-4ba2-9bbb-3554ac0000b8 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:53.042881 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d44b-c4e9-4ba2-9bbb-3554ac0000b8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:53.043083 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf4d44b-c4e9-4ba2-9bbb-3554ac0000b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:53.062147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-ddf4d44b-c4e9-4ba2-9bbb-3554ac0000b8 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:53.063370 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ddf4d44b-c4e9-4ba2-9bbb-3554ac0000b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:53.129153 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1321/2636] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:53.140193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:53.141590 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:53.200168 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383df3c4-cf05-4a49-a2ce-881db62926eb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:53.203750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b994-b1e0-4321-a1ec-8cb74cd1f422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:53.204388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b994-b1e0-4321-a1ec-8cb74cd1f422 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:53.204668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b994-b1e0-4321-a1ec-8cb74cd1f422 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:53.204943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b994-b1e0-4321-a1ec-8cb74cd1f422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:53.214604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026b994-b1e0-4321-a1ec-8cb74cd1f422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:53.220174 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026b994-b1e0-4321-a1ec-8cb74cd1f422 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:53.225475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1316/2637] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:53.619999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4d44b-c4e9-4ba2-9bbb-3554ac0000b8 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:53.622060 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ddf4d44b-c4e9-4ba2-9bbb-3554ac0000b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:53.636734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf4d44b-c4e9-4ba2-9bbb-3554ac0000b8 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:53.641674 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:53.642539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:53.643051 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:53.643335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] PATH_INFO: `/v3/projects/da0819e3c21245399b7e6c6c2701f549` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:53.644857 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0819e3c21245399b7e6c6c2701f549)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:53.646858 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:53.792479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0819e3c21245399b7e6c6c2701f549', 'request_id': 'req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:53.860059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0819e3c21245399b7e6c6c2701f549', 'request_id': 'req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:53.870232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0819e3c21245399b7e6c6c2701f549', 'request_id': 'req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:53.879292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] The token cache is being invalidate because project da0819e3c21245399b7e6c6c2701f549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:53.879572 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:53.880245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:53.881797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1322/2638] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:53 2022] DELETE /identity/v3/projects/da0819e3c21245399b7e6c6c2701f549 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:53.886287 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b994-b1e0-4321-a1ec-8cb74cd1f422 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:53.897113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b994-b1e0-4321-a1ec-8cb74cd1f422 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:53.900967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:53.956350 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:53.957271 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:53.957560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:53.957840 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] PATH_INFO: `/v3/users/ab6e616e7ba14f24bd9a5af261d87642` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:53.959075 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6e616e7ba14f24bd9a5af261d87642)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:53.961207 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:54.160860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6e616e7ba14f24bd9a5af261d87642'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:54.220880 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6e616e7ba14f24bd9a5af261d87642'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:54.234150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6e616e7ba14f24bd9a5af261d87642'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:54.234799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6e616e7ba14f24bd9a5af261d87642'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:54.235422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6e616e7ba14f24bd9a5af261d87642'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:54.248885 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1317/2639] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:53 2022] DELETE /identity/v3/users/ab6e616e7ba14f24bd9a5af261d87642 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:54.635149 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:54.636815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:54.652579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fb8ff-ad01-4d7a-97c6-da46fae614cc admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:54.667970 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:54.706439 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:54.708256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:54.717647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:54.718703 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:54.719537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:54.720059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] PATH_INFO: `/v3/projects/34e10359c3af492dbdcb75c617ba62cd` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:54.721935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34e10359c3af492dbdcb75c617ba62cd)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:54.723956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:54.775813 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5181fc-75c5-4c5c-8958-c4b553784fbb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:54.780535 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d04225-9613-45db-851a-e434dc3b863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:54.781400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d04225-9613-45db-851a-e434dc3b863b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:54.781682 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d04225-9613-45db-851a-e434dc3b863b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:54.781960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d04225-9613-45db-851a-e434dc3b863b admin admin] PATH_INFO: `/v3/users/269b10aff78743c4a6c55e0b62fe2cd7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:54.783142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d04225-9613-45db-851a-e434dc3b863b admin admin] RBAC: Authorizing `identity:delete_user(user_id=269b10aff78743c4a6c55e0b62fe2cd7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:54.785097 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d04225-9613-45db-851a-e434dc3b863b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:54.872413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34e10359c3af492dbdcb75c617ba62cd', 'request_id': 'req-64735b17-9f64-4d63-9fad-5f64af57fd12'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:54.932845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:54.958796 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34e10359c3af492dbdcb75c617ba62cd', 'request_id': 'req-64735b17-9f64-4d63-9fad-5f64af57fd12'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:54.966158 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34e10359c3af492dbdcb75c617ba62cd', 'request_id': 'req-64735b17-9f64-4d63-9fad-5f64af57fd12'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:54.976512 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] The token cache is being invalidate because project 34e10359c3af492dbdcb75c617ba62cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:54.976804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:54.977447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-64735b17-9f64-4d63-9fad-5f64af57fd12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:54.978996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1323/2640] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:54 2022] DELETE /identity/v3/projects/34e10359c3af492dbdcb75c617ba62cd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:54.983797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4413f-75c2-4333-966b-1428e08b58f8 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:54.984089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4413f-75c2-4333-966b-1428e08b58f8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:54.984371 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4413f-75c2-4333-966b-1428e08b58f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.002910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c9d4413f-75c2-4333-966b-1428e08b58f8 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:55.006267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c9d4413f-75c2-4333-966b-1428e08b58f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:55.013473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d9d04225-9613-45db-851a-e434dc3b863b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269b10aff78743c4a6c55e0b62fe2cd7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:55.063467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1324/2641] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:55.073195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6372be3-9543-4e9d-849c-e1b2144eb869 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.073491 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6372be3-9543-4e9d-849c-e1b2144eb869 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.073774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6372be3-9543-4e9d-849c-e1b2144eb869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.088943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d9d04225-9613-45db-851a-e434dc3b863b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269b10aff78743c4a6c55e0b62fe2cd7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:55.091722 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a6372be3-9543-4e9d-849c-e1b2144eb869 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:55.092937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a6372be3-9543-4e9d-849c-e1b2144eb869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:55.101013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1325/2642] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:55.101581 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d9d04225-9613-45db-851a-e434dc3b863b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269b10aff78743c4a6c55e0b62fe2cd7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:55.102138 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d9d04225-9613-45db-851a-e434dc3b863b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269b10aff78743c4a6c55e0b62fe2cd7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:55.102754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d9d04225-9613-45db-851a-e434dc3b863b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269b10aff78743c4a6c55e0b62fe2cd7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:55.105012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6372be3-9543-4e9d-849c-e1b2144eb869 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:55.113678 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6372be3-9543-4e9d-849c-e1b2144eb869 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:55.114908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1318/2643] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:54 2022] DELETE /identity/v3/users/269b10aff78743c4a6c55e0b62fe2cd7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:55.120066 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f28a5-f56d-4b33-8816-c6a29ba43a77 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.120406 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f28a5-f56d-4b33-8816-c6a29ba43a77 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.120733 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f28a5-f56d-4b33-8816-c6a29ba43a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.138840 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b43f28a5-f56d-4b33-8816-c6a29ba43a77 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:55.140086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b43f28a5-f56d-4b33-8816-c6a29ba43a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:55.173654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bb4ae-ed58-4f93-b79c-fcbc6fa05042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:55.174438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb4ae-ed58-4f93-b79c-fcbc6fa05042 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.174687 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb4ae-ed58-4f93-b79c-fcbc6fa05042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.175535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb4ae-ed58-4f93-b79c-fcbc6fa05042 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.175730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bb4ae-ed58-4f93-b79c-fcbc6fa05042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:19:55.176045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bb4ae-ed58-4f93-b79c-fcbc6fa05042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:55.177658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bb4ae-ed58-4f93-b79c-fcbc6fa05042 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:55.189768 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1326/2644] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:19:55.193965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bb4ae-ed58-4f93-b79c-fcbc6fa05042 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:55.196606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-011bb4ae-ed58-4f93-b79c-fcbc6fa05042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:55.201777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1319/2645] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:55.209355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bb4ae-ed58-4f93-b79c-fcbc6fa05042 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:55.211547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f28a5-f56d-4b33-8816-c6a29ba43a77 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:55.212919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b43f28a5-f56d-4b33-8816-c6a29ba43a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:55.214873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bfa7f-6d2a-4dcc-96a1-ada0abcc5e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:55.215530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bfa7f-6d2a-4dcc-96a1-ada0abcc5e04 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.215851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bfa7f-6d2a-4dcc-96a1-ada0abcc5e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.216143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bfa7f-6d2a-4dcc-96a1-ada0abcc5e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.219297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bfa7f-6d2a-4dcc-96a1-ada0abcc5e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:55.219297 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bfa7f-6d2a-4dcc-96a1-ada0abcc5e04 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:55.237959 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:55.269754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f28a5-f56d-4b33-8816-c6a29ba43a77 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:55.274495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4933a8-acd6-45ea-944b-363e89382347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:55.274495 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4933a8-acd6-45ea-944b-363e89382347 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.275037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4933a8-acd6-45ea-944b-363e89382347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.275037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4933a8-acd6-45ea-944b-363e89382347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.283895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4933a8-acd6-45ea-944b-363e89382347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:55.287639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4933a8-acd6-45ea-944b-363e89382347 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:55.295223 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1320/2646] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:19:55.343559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1327/2647] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:55 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:55.347763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4933a8-acd6-45ea-944b-363e89382347 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:55.358104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4933a8-acd6-45ea-944b-363e89382347 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:55.416660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b9ef-ad42-4a0d-86b8-be49a32f5e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:55.417329 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b9ef-ad42-4a0d-86b8-be49a32f5e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.417611 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b9ef-ad42-4a0d-86b8-be49a32f5e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.417886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87b9ef-ad42-4a0d-86b8-be49a32f5e66 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.418584 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87b9ef-ad42-4a0d-86b8-be49a32f5e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:55.420528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87b9ef-ad42-4a0d-86b8-be49a32f5e66 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:55.501824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1321/2648] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:55 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:55.505867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bfa7f-6d2a-4dcc-96a1-ada0abcc5e04 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:55.513347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:55.518388 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bfa7f-6d2a-4dcc-96a1-ada0abcc5e04 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:55.526224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e2c1b-1d0d-458a-8343-98b5d508facc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:55.526947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e2c1b-1d0d-458a-8343-98b5d508facc admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.527241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e2c1b-1d0d-458a-8343-98b5d508facc admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.527525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e2c1b-1d0d-458a-8343-98b5d508facc admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.528304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e2c1b-1d0d-458a-8343-98b5d508facc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:55.534662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e2c1b-1d0d-458a-8343-98b5d508facc admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:55.546127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1328/2649] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:55.550222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b9ef-ad42-4a0d-86b8-be49a32f5e66 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:55.561525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87b9ef-ad42-4a0d-86b8-be49a32f5e66 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:55.566358 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f5835-cefc-43c3-8163-19c41e8c105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:55.567117 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f5835-cefc-43c3-8163-19c41e8c105a admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.567556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f5835-cefc-43c3-8163-19c41e8c105a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.567936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f5835-cefc-43c3-8163-19c41e8c105a admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.568735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f5835-cefc-43c3-8163-19c41e8c105a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:55.570952 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f5835-cefc-43c3-8163-19c41e8c105a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:55.581753 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1322/2650] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:55.586767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e2c1b-1d0d-458a-8343-98b5d508facc admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:55.596679 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e2c1b-1d0d-458a-8343-98b5d508facc admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:55.601685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a3b59-f740-4318-b8de-83931fd334b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:55.602659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a3b59-f740-4318-b8de-83931fd334b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.602945 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a3b59-f740-4318-b8de-83931fd334b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.603225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a3b59-f740-4318-b8de-83931fd334b1 admin admin] PATH_INFO: `/v3/projects/1422b17913f948f6b55dd0fe59656127/users/5c280eccc50a4c29856d4b93c3a7c087/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.619205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a3b59-f740-4318-b8de-83931fd334b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1422b17913f948f6b55dd0fe59656127, user_id=5c280eccc50a4c29856d4b93c3a7c087, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:55.621915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a3b59-f740-4318-b8de-83931fd334b1 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:55.678372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1329/2651] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:55 2022] PUT /identity/v3/projects/1422b17913f948f6b55dd0fe59656127/users/5c280eccc50a4c29856d4b93c3a7c087/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:55.689572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa2634-61c3-4b1a-ad2d-f44c40f9fe8c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.689863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa2634-61c3-4b1a-ad2d-f44c40f9fe8c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.690140 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa2634-61c3-4b1a-ad2d-f44c40f9fe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.718683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-09aa2634-61c3-4b1a-ad2d-f44c40f9fe8c None None] MFA Rules not processed for user `5c280eccc50a4c29856d4b93c3a7c087`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:55.719991 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-09aa2634-61c3-4b1a-ad2d-f44c40f9fe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:55.754031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a3b59-f740-4318-b8de-83931fd334b1 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:55.755928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a35a3b59-f740-4318-b8de-83931fd334b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:55.791920 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1323/2652] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:55.792951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa2634-61c3-4b1a-ad2d-f44c40f9fe8c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:55.841734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a3b59-f740-4318-b8de-83931fd334b1 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:55.846476 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:55.847333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.847664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.847947 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] PATH_INFO: `/v3/projects/b51ec606eef243debf2f55fb17bb7d8c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.849146 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51ec606eef243debf2f55fb17bb7d8c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:55.851103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:55.858191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa2634-61c3-4b1a-ad2d-f44c40f9fe8c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:55.863461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e72de-5389-46c9-9c51-35d76ef2f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:55.864147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e72de-5389-46c9-9c51-35d76ef2f20e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:55.864438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e72de-5389-46c9-9c51-35d76ef2f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:55.864714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e72de-5389-46c9-9c51-35d76ef2f20e admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:55.865410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e72de-5389-46c9-9c51-35d76ef2f20e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:55.868062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e72de-5389-46c9-9c51-35d76ef2f20e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:55.940184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51ec606eef243debf2f55fb17bb7d8c', 'request_id': 'req-9133130a-2b0c-4213-827c-4dad85771978'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:55.953070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1324/2653] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:55 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:55.957084 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e72de-5389-46c9-9c51-35d76ef2f20e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:56.001909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:56.018388 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e72de-5389-46c9-9c51-35d76ef2f20e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:56.021041 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51ec606eef243debf2f55fb17bb7d8c', 'request_id': 'req-9133130a-2b0c-4213-827c-4dad85771978'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:56.023905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079b951-3a82-4c84-9bdf-1eb11d48a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:56.024640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b951-3a82-4c84-9bdf-1eb11d48a18e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:56.024926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b951-3a82-4c84-9bdf-1eb11d48a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:56.025202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b951-3a82-4c84-9bdf-1eb11d48a18e admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:56.025887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079b951-3a82-4c84-9bdf-1eb11d48a18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:56.027855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079b951-3a82-4c84-9bdf-1eb11d48a18e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:56.032500 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51ec606eef243debf2f55fb17bb7d8c', 'request_id': 'req-9133130a-2b0c-4213-827c-4dad85771978'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:56.039884 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] The token cache is being invalidate because project b51ec606eef243debf2f55fb17bb7d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:56.040172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:56.040851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:56.042523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1330/2654] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:55 2022] DELETE /identity/v3/projects/b51ec606eef243debf2f55fb17bb7d8c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:56.046505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:56.047911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:56.058307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:56.111847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133130a-2b0c-4213-827c-4dad85771978 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:56.116723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:56.117878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:56.118165 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:56.118452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] PATH_INFO: `/v3/users/e2cb3d282b7f4f83b1c2e2a60b9bea5a` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:56.119733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cb3d282b7f4f83b1c2e2a60b9bea5a)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:56.121652 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:56.129951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1325/2655] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:55 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:56.134946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079b951-3a82-4c84-9bdf-1eb11d48a18e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:56.136898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1079b951-3a82-4c84-9bdf-1eb11d48a18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:56.149503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079b951-3a82-4c84-9bdf-1eb11d48a18e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:56.154006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f237fb-29a3-4573-8f02-fc55a2dcc724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:56.154656 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f237fb-29a3-4573-8f02-fc55a2dcc724 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:56.154942 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f237fb-29a3-4573-8f02-fc55a2dcc724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:56.155222 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f237fb-29a3-4573-8f02-fc55a2dcc724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:56.155981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f237fb-29a3-4573-8f02-fc55a2dcc724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:56.157613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f237fb-29a3-4573-8f02-fc55a2dcc724 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:56.167617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1326/2656] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:56.171622 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f237fb-29a3-4573-8f02-fc55a2dcc724 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:56.181109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f237fb-29a3-4573-8f02-fc55a2dcc724 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:56.185608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7b60c-2927-4607-aa81-af7b0198fac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:56.186454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7b60c-2927-4607-aa81-af7b0198fac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:56.186737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7b60c-2927-4607-aa81-af7b0198fac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:56.187016 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7b60c-2927-4607-aa81-af7b0198fac7 admin admin] PATH_INFO: `/v3/projects/99d8a5aa58c347cfbaf9504908ec8288/users/8addf2fc589040b19a8cc1d2dd6bf12a/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:56.202074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7b60c-2927-4607-aa81-af7b0198fac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d8a5aa58c347cfbaf9504908ec8288, user_id=8addf2fc589040b19a8cc1d2dd6bf12a, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:56.204808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7b60c-2927-4607-aa81-af7b0198fac7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:56.274483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1327/2657] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:56 2022] PUT /identity/v3/projects/99d8a5aa58c347cfbaf9504908ec8288/users/8addf2fc589040b19a8cc1d2dd6bf12a/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:56.278304 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7b60c-2927-4607-aa81-af7b0198fac7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:56.310320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cb3d282b7f4f83b1c2e2a60b9bea5a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:56.323271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cb3d282b7f4f83b1c2e2a60b9bea5a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:56.323998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cb3d282b7f4f83b1c2e2a60b9bea5a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:56.330863 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cb3d282b7f4f83b1c2e2a60b9bea5a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:56.331499 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cb3d282b7f4f83b1c2e2a60b9bea5a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:56.341763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7b60c-2927-4607-aa81-af7b0198fac7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:56.346817 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5898b8b-27f0-432e-b275-a22a8624ccf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:56.347489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898b8b-27f0-432e-b275-a22a8624ccf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:56.347816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898b8b-27f0-432e-b275-a22a8624ccf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:56.348101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898b8b-27f0-432e-b275-a22a8624ccf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:56.348894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5898b8b-27f0-432e-b275-a22a8624ccf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:56.350532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5898b8b-27f0-432e-b275-a22a8624ccf5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:56.360576 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1328/2658] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:56.364554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5898b8b-27f0-432e-b275-a22a8624ccf5 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:56.366202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b5898b8b-27f0-432e-b275-a22a8624ccf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:56.378818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5898b8b-27f0-432e-b275-a22a8624ccf5 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:56.384191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b111b-6fd0-4b73-a5bb-b33aadf06eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:56.385041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b111b-6fd0-4b73-a5bb-b33aadf06eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:56.386959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b111b-6fd0-4b73-a5bb-b33aadf06eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:56.386959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b111b-6fd0-4b73-a5bb-b33aadf06eb4 admin admin] PATH_INFO: `/v3/projects/99d8a5aa58c347cfbaf9504908ec8288/users/8addf2fc589040b19a8cc1d2dd6bf12a/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:56.387605 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b111b-6fd0-4b73-a5bb-b33aadf06eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d8a5aa58c347cfbaf9504908ec8288, user_id=8addf2fc589040b19a8cc1d2dd6bf12a, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:56.390262 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b111b-6fd0-4b73-a5bb-b33aadf06eb4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:56.401564 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1329/2659] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:56 2022] PUT /identity/v3/projects/99d8a5aa58c347cfbaf9504908ec8288/users/8addf2fc589040b19a8cc1d2dd6bf12a/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:56.409633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1331/2660] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:56 2022] DELETE /identity/v3/users/e2cb3d282b7f4f83b1c2e2a60b9bea5a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:56.415824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc8bab-f3b0-451c-8c52-c13decf87bf9 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:56.415824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc8bab-f3b0-451c-8c52-c13decf87bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:56.415824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc8bab-f3b0-451c-8c52-c13decf87bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:56.440999 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b4dc8bab-f3b0-451c-8c52-c13decf87bf9 None None] MFA Rules not processed for user `8addf2fc589040b19a8cc1d2dd6bf12a`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:56.442219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b4dc8bab-f3b0-451c-8c52-c13decf87bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:56.516415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1330/2661] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:56.528463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:56.529805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:56.589420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e11cee-e3a1-42fd-ae4c-a5844b55b8c2 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:56.593243 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e5cd2-6f3f-4a8c-87d1-95a7297d2876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:56.593930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e5cd2-6f3f-4a8c-87d1-95a7297d2876 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:56.594221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e5cd2-6f3f-4a8c-87d1-95a7297d2876 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:56.594501 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e5cd2-6f3f-4a8c-87d1-95a7297d2876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:56.604606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e5cd2-6f3f-4a8c-87d1-95a7297d2876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:56.606064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e5cd2-6f3f-4a8c-87d1-95a7297d2876 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:56.616940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1332/2662] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:56.648662 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc8bab-f3b0-451c-8c52-c13decf87bf9 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:56.654814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:56.714509 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc8bab-f3b0-451c-8c52-c13decf87bf9 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:56.719876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f462614-3ec9-49c4-a86a-3bb30ad5c811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:56.720760 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462614-3ec9-49c4-a86a-3bb30ad5c811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:56.721047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462614-3ec9-49c4-a86a-3bb30ad5c811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:56.721324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462614-3ec9-49c4-a86a-3bb30ad5c811 admin admin] PATH_INFO: `/v3/users/5c280eccc50a4c29856d4b93c3a7c087` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:56.722617 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f462614-3ec9-49c4-a86a-3bb30ad5c811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c280eccc50a4c29856d4b93c3a7c087)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:56.724633 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f462614-3ec9-49c4-a86a-3bb30ad5c811 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:56.862807 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e5cd2-6f3f-4a8c-87d1-95a7297d2876 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:56.864357 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-886e5cd2-6f3f-4a8c-87d1-95a7297d2876 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:56.885001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e5cd2-6f3f-4a8c-87d1-95a7297d2876 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:56.889973 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:56.890749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:56.891038 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:56.891385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] PATH_INFO: `/v3/projects/1e551f8bba574320a72935c7d4ee760b` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:56.892523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e551f8bba574320a72935c7d4ee760b)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:56.894733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:56.949132 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0f462614-3ec9-49c4-a86a-3bb30ad5c811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c280eccc50a4c29856d4b93c3a7c087'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.022648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:57.032582 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0f462614-3ec9-49c4-a86a-3bb30ad5c811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c280eccc50a4c29856d4b93c3a7c087'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.041667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e551f8bba574320a72935c7d4ee760b', 'request_id': 'req-15f101d4-26e4-43fc-b351-bb16bf04dc57'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.045903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0f462614-3ec9-49c4-a86a-3bb30ad5c811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c280eccc50a4c29856d4b93c3a7c087'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.046655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0f462614-3ec9-49c4-a86a-3bb30ad5c811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c280eccc50a4c29856d4b93c3a7c087'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.047291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0f462614-3ec9-49c4-a86a-3bb30ad5c811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c280eccc50a4c29856d4b93c3a7c087'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.059962 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1331/2663] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:56 2022] DELETE /identity/v3/users/5c280eccc50a4c29856d4b93c3a7c087 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:57.064158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ad786-bfc4-426f-a1d1-52dff7552c63 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.064493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ad786-bfc4-426f-a1d1-52dff7552c63 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.064776 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ad786-bfc4-426f-a1d1-52dff7552c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.081887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-de0ad786-bfc4-426f-a1d1-52dff7552c63 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:57.083100 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-de0ad786-bfc4-426f-a1d1-52dff7552c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:57.100334 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e551f8bba574320a72935c7d4ee760b', 'request_id': 'req-15f101d4-26e4-43fc-b351-bb16bf04dc57'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.106964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e551f8bba574320a72935c7d4ee760b', 'request_id': 'req-15f101d4-26e4-43fc-b351-bb16bf04dc57'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.117634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] The token cache is being invalidate because project 1e551f8bba574320a72935c7d4ee760b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:57.117911 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.118553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-15f101d4-26e4-43fc-b351-bb16bf04dc57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.120128 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1333/2664] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:56 2022] DELETE /identity/v3/projects/1e551f8bba574320a72935c7d4ee760b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:57.124998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33686af-c528-4042-8b6d-455dd4d89072 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.125283 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33686af-c528-4042-8b6d-455dd4d89072 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.125647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33686af-c528-4042-8b6d-455dd4d89072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.144217 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c33686af-c528-4042-8b6d-455dd4d89072 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:57.145442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c33686af-c528-4042-8b6d-455dd4d89072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:57.145910 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1332/2665] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:57.155614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1334/2666] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:57.157721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ad786-bfc4-426f-a1d1-52dff7552c63 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:57.159127 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-de0ad786-bfc4-426f-a1d1-52dff7552c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:57.162307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5164f-290a-4a78-896f-3786eeedc126 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.162628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5164f-290a-4a78-896f-3786eeedc126 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.162908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5164f-290a-4a78-896f-3786eeedc126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.181673 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f6c5164f-290a-4a78-896f-3786eeedc126 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:57.182874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f6c5164f-290a-4a78-896f-3786eeedc126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:57.188814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:57.191527 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1335/2667] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:57.195764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5164f-290a-4a78-896f-3786eeedc126 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:57.204567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5164f-290a-4a78-896f-3786eeedc126 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:57.209128 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e19e7d-941a-4c65-a4f6-59fc68be453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:57.209764 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e19e7d-941a-4c65-a4f6-59fc68be453b admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.210046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e19e7d-941a-4c65-a4f6-59fc68be453b admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.210904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e19e7d-941a-4c65-a4f6-59fc68be453b admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.211676 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e19e7d-941a-4c65-a4f6-59fc68be453b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:19:57.211989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e19e7d-941a-4c65-a4f6-59fc68be453b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:57.213570 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e19e7d-941a-4c65-a4f6-59fc68be453b admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:57.219736 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ad786-bfc4-426f-a1d1-52dff7552c63 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:57.224226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29ed14-53e9-4836-b667-9396b5850ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:57.224790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29ed14-53e9-4836-b667-9396b5850ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.225080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29ed14-53e9-4836-b667-9396b5850ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.225363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29ed14-53e9-4836-b667-9396b5850ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.226948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1336/2668] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:19:57.231437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e19e7d-941a-4c65-a4f6-59fc68be453b admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:57.236436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29ed14-53e9-4836-b667-9396b5850ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:57.237939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29ed14-53e9-4836-b667-9396b5850ae3 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:57.242273 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e19e7d-941a-4c65-a4f6-59fc68be453b admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:57.247563 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae81abc-b489-4725-8c2d-18afa1dfd1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:57.248552 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae81abc-b489-4725-8c2d-18afa1dfd1ed admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.248846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae81abc-b489-4725-8c2d-18afa1dfd1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.249184 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae81abc-b489-4725-8c2d-18afa1dfd1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.250002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae81abc-b489-4725-8c2d-18afa1dfd1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:57.251560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1333/2669] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:57.252023 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae81abc-b489-4725-8c2d-18afa1dfd1ed admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:57.342664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1337/2670] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:57 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:57.347361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29ed14-53e9-4836-b667-9396b5850ae3 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:57.357191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29ed14-53e9-4836-b667-9396b5850ae3 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:57.416833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07adaf-d032-4d29-b5b0-6a358707dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:57.417790 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07adaf-d032-4d29-b5b0-6a358707dff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.418072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07adaf-d032-4d29-b5b0-6a358707dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.418351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07adaf-d032-4d29-b5b0-6a358707dff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.419055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07adaf-d032-4d29-b5b0-6a358707dff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:57.421081 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07adaf-d032-4d29-b5b0-6a358707dff8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:57.517906 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1334/2671] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:57 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:57.522221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae81abc-b489-4725-8c2d-18afa1dfd1ed admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:57.533696 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae81abc-b489-4725-8c2d-18afa1dfd1ed admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:57.539103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac7d99-aeb8-426b-bfc0-b1053cc54e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:57.539797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7d99-aeb8-426b-bfc0-b1053cc54e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.540119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7d99-aeb8-426b-bfc0-b1053cc54e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.540369 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7d99-aeb8-426b-bfc0-b1053cc54e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.541102 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac7d99-aeb8-426b-bfc0-b1053cc54e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:57.542713 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac7d99-aeb8-426b-bfc0-b1053cc54e29 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:57.557705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1338/2672] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:57.559283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07adaf-d032-4d29-b5b0-6a358707dff8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:57.572549 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07adaf-d032-4d29-b5b0-6a358707dff8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:57.577423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107900f-851d-42ea-9adf-352c53586a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:57.578080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107900f-851d-42ea-9adf-352c53586a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.578361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107900f-851d-42ea-9adf-352c53586a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.578639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107900f-851d-42ea-9adf-352c53586a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.579410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107900f-851d-42ea-9adf-352c53586a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:57.581064 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107900f-851d-42ea-9adf-352c53586a1f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:57.592352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1335/2673] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:57.596475 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac7d99-aeb8-426b-bfc0-b1053cc54e29 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:57.606993 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac7d99-aeb8-426b-bfc0-b1053cc54e29 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:57.611688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c70f26-b6ec-4b0d-ba2f-275292901800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:57.612489 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c70f26-b6ec-4b0d-ba2f-275292901800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.612775 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c70f26-b6ec-4b0d-ba2f-275292901800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.613058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c70f26-b6ec-4b0d-ba2f-275292901800 admin admin] PATH_INFO: `/v3/projects/fbc29090e7304a7fa2d0a76fb572708f/users/96e7af8abba545708c5304b38e9e0b3c/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.628643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c70f26-b6ec-4b0d-ba2f-275292901800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc29090e7304a7fa2d0a76fb572708f, user_id=96e7af8abba545708c5304b38e9e0b3c, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:57.631330 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c70f26-b6ec-4b0d-ba2f-275292901800 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:57.657398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107900f-851d-42ea-9adf-352c53586a1f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:57.659178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8107900f-851d-42ea-9adf-352c53586a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:57.675025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107900f-851d-42ea-9adf-352c53586a1f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:57.681903 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:57.682204 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.682458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.682758 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] PATH_INFO: `/v3/projects/1422b17913f948f6b55dd0fe59656127` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.684074 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1422b17913f948f6b55dd0fe59656127)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:57.685879 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:57.741717 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1339/2674] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:57 2022] PUT /identity/v3/projects/fbc29090e7304a7fa2d0a76fb572708f/users/96e7af8abba545708c5304b38e9e0b3c/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:57.751938 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75530dc-12ba-4789-b326-7806cd8fb5f8 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.752231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75530dc-12ba-4789-b326-7806cd8fb5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.752509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75530dc-12ba-4789-b326-7806cd8fb5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.780258 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e75530dc-12ba-4789-b326-7806cd8fb5f8 None None] MFA Rules not processed for user `96e7af8abba545708c5304b38e9e0b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:57.781447 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e75530dc-12ba-4789-b326-7806cd8fb5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:57.805717 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1422b17913f948f6b55dd0fe59656127', 'request_id': 'req-663ea7da-a73a-4f24-9e2c-7eac17d171c8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.811437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1422b17913f948f6b55dd0fe59656127', 'request_id': 'req-663ea7da-a73a-4f24-9e2c-7eac17d171c8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.818409 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1422b17913f948f6b55dd0fe59656127', 'request_id': 'req-663ea7da-a73a-4f24-9e2c-7eac17d171c8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.848626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1340/2675] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:19:57.853511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75530dc-12ba-4789-b326-7806cd8fb5f8 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:57.873507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:57.889673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] The token cache is being invalidate because project 1422b17913f948f6b55dd0fe59656127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:57.890063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.890714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:57.894159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1336/2676] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:57 2022] DELETE /identity/v3/projects/1422b17913f948f6b55dd0fe59656127 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:57.896420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:57.898422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:57.918749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75530dc-12ba-4789-b326-7806cd8fb5f8 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:57.931833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:57.968802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ea7da-a73a-4f24-9e2c-7eac17d171c8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:57.974243 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:57.975170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.975460 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.975781 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] PATH_INFO: `/v3/users/8addf2fc589040b19a8cc1d2dd6bf12a` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.977443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8addf2fc589040b19a8cc1d2dd6bf12a)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:57.979399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30977355-1d2a-440c-ab7d-c3375e07aaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:57.979399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30977355-1d2a-440c-ab7d-c3375e07aaf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:57.979399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30977355-1d2a-440c-ab7d-c3375e07aaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:57.979399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30977355-1d2a-440c-ab7d-c3375e07aaf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:57.979782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:57.979961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30977355-1d2a-440c-ab7d-c3375e07aaf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:57.981872 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30977355-1d2a-440c-ab7d-c3375e07aaf6 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:58.120824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1341/2677] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:57 2022] POST /identity/v3/projects => generated 381 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:58.124755 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30977355-1d2a-440c-ab7d-c3375e07aaf6 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:58.126338 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-30977355-1d2a-440c-ab7d-c3375e07aaf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:58.183945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8addf2fc589040b19a8cc1d2dd6bf12a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:58.190545 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30977355-1d2a-440c-ab7d-c3375e07aaf6 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:58.195997 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b953f-8781-4fc1-8a74-871c1e2a1f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:58.197168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b953f-8781-4fc1-8a74-871c1e2a1f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:58.197168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b953f-8781-4fc1-8a74-871c1e2a1f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:58.197168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b953f-8781-4fc1-8a74-871c1e2a1f40 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:58.197887 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b953f-8781-4fc1-8a74-871c1e2a1f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:58.199819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b953f-8781-4fc1-8a74-871c1e2a1f40 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:58.261235 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8addf2fc589040b19a8cc1d2dd6bf12a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:58.274275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8addf2fc589040b19a8cc1d2dd6bf12a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:58.274995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8addf2fc589040b19a8cc1d2dd6bf12a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:58.275745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8addf2fc589040b19a8cc1d2dd6bf12a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:58.288727 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1337/2678] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:19:57 2022] DELETE /identity/v3/users/8addf2fc589040b19a8cc1d2dd6bf12a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:58.290452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1342/2679] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:58 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:19:58.300938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:58.302328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:58.370080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd2947-366d-4526-80ca-e4eab87f8f42 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:58.374723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcef77-bfd8-4fc9-adc6-9f60e0ea5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:58.375331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcef77-bfd8-4fc9-adc6-9f60e0ea5da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:58.375661 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcef77-bfd8-4fc9-adc6-9f60e0ea5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:58.375969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcef77-bfd8-4fc9-adc6-9f60e0ea5da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:58.376700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcef77-bfd8-4fc9-adc6-9f60e0ea5da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:58.378294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcef77-bfd8-4fc9-adc6-9f60e0ea5da7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:58.388612 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1338/2680] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:58.392554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b953f-8781-4fc1-8a74-871c1e2a1f40 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:58.402996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b953f-8781-4fc1-8a74-871c1e2a1f40 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:58.407606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538bcb1-1a80-46f7-bf32-c2cbb0fff7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:58.408498 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538bcb1-1a80-46f7-bf32-c2cbb0fff7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:58.408785 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538bcb1-1a80-46f7-bf32-c2cbb0fff7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:58.409061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538bcb1-1a80-46f7-bf32-c2cbb0fff7eb admin admin] PATH_INFO: `/v3/projects/54ab319b3b25470d827d29f5473f359e/users/77832f43876547748b1e34c83c4952c3/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:58.424555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538bcb1-1a80-46f7-bf32-c2cbb0fff7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ab319b3b25470d827d29f5473f359e, user_id=77832f43876547748b1e34c83c4952c3, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:58.427175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538bcb1-1a80-46f7-bf32-c2cbb0fff7eb admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:58.534331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1343/2681] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:58 2022] PUT /identity/v3/projects/54ab319b3b25470d827d29f5473f359e/users/77832f43876547748b1e34c83c4952c3/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:58.535672 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcef77-bfd8-4fc9-adc6-9f60e0ea5da7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:58.546812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcef77-bfd8-4fc9-adc6-9f60e0ea5da7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:58.596543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:58.612440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f513c7e-b6f9-4dc5-a7d6-04bbf3f73854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:58.614444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f513c7e-b6f9-4dc5-a7d6-04bbf3f73854 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:58.614444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f513c7e-b6f9-4dc5-a7d6-04bbf3f73854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:58.614444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f513c7e-b6f9-4dc5-a7d6-04bbf3f73854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:58.614444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f513c7e-b6f9-4dc5-a7d6-04bbf3f73854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:58.616034 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f513c7e-b6f9-4dc5-a7d6-04bbf3f73854 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:58.626785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1339/2682] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:58.630917 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538bcb1-1a80-46f7-bf32-c2cbb0fff7eb admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:58.641966 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538bcb1-1a80-46f7-bf32-c2cbb0fff7eb admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:58.647051 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8d95-cb41-41b3-9c1a-6f77a74fae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:58.648586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8d95-cb41-41b3-9c1a-6f77a74fae23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:58.648849 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8d95-cb41-41b3-9c1a-6f77a74fae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:58.649122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc8d95-cb41-41b3-9c1a-6f77a74fae23 admin admin] PATH_INFO: `/v3/projects/54ab319b3b25470d827d29f5473f359e/users/77832f43876547748b1e34c83c4952c3/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:58.651122 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc8d95-cb41-41b3-9c1a-6f77a74fae23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ab319b3b25470d827d29f5473f359e, user_id=77832f43876547748b1e34c83c4952c3, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:58.653806 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc8d95-cb41-41b3-9c1a-6f77a74fae23 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:58.663894 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1344/2683] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:58 2022] PUT /identity/v3/projects/54ab319b3b25470d827d29f5473f359e/users/77832f43876547748b1e34c83c4952c3/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:58.675048 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f6d8b-afd6-4935-b113-af1e33b77737 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:58.675344 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f6d8b-afd6-4935-b113-af1e33b77737 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:58.675660 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f6d8b-afd6-4935-b113-af1e33b77737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:58.702808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-075f6d8b-afd6-4935-b113-af1e33b77737 None None] MFA Rules not processed for user `77832f43876547748b1e34c83c4952c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:58.704083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-075f6d8b-afd6-4935-b113-af1e33b77737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:58.719729 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8d95-cb41-41b3-9c1a-6f77a74fae23 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:58.721505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-82cc8d95-cb41-41b3-9c1a-6f77a74fae23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:58.728683 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:58.782114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1340/2684] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:58.793196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc8d95-cb41-41b3-9c1a-6f77a74fae23 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:58.797979 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f6d8b-afd6-4935-b113-af1e33b77737 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:58.798183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:58.799044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:58.799328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:58.799628 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] PATH_INFO: `/v3/projects/99d8a5aa58c347cfbaf9504908ec8288` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:58.800013 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-075f6d8b-afd6-4935-b113-af1e33b77737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:58.800829 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d8a5aa58c347cfbaf9504908ec8288)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:58.802735 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:58.858181 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f6d8b-afd6-4935-b113-af1e33b77737 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:58.861863 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fde527-5675-4b52-bc1d-24bb1eee564a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:58.862506 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde527-5675-4b52-bc1d-24bb1eee564a service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:58.862789 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde527-5675-4b52-bc1d-24bb1eee564a service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:58.863067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fde527-5675-4b52-bc1d-24bb1eee564a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:58.873183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fde527-5675-4b52-bc1d-24bb1eee564a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:58.874607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fde527-5675-4b52-bc1d-24bb1eee564a service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:58.885129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1341/2685] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:19:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:19:58.907292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d8a5aa58c347cfbaf9504908ec8288', 'request_id': 'req-f5969c4a-cd82-4e2e-bf48-257b63bc1888'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:58.985845 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d8a5aa58c347cfbaf9504908ec8288', 'request_id': 'req-f5969c4a-cd82-4e2e-bf48-257b63bc1888'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:58.992623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d8a5aa58c347cfbaf9504908ec8288', 'request_id': 'req-f5969c4a-cd82-4e2e-bf48-257b63bc1888'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:59.002644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] The token cache is being invalidate because project 99d8a5aa58c347cfbaf9504908ec8288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:19:59.002928 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:59.003567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-f5969c4a-cd82-4e2e-bf48-257b63bc1888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:19:59.005123 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1345/2686] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:19:58 2022] DELETE /identity/v3/projects/99d8a5aa58c347cfbaf9504908ec8288 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:19:59.010193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fa633-6aeb-41e0-9c92-2d82174ff0da None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.010514 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fa633-6aeb-41e0-9c92-2d82174ff0da None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.010798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fa633-6aeb-41e0-9c92-2d82174ff0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.029468 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-656fa633-6aeb-41e0-9c92-2d82174ff0da None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:59.030690 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-656fa633-6aeb-41e0-9c92-2d82174ff0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:59.092186 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1342/2687] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:59.101670 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fc192-8f06-477f-a596-0a623144e808 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.102013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fc192-8f06-477f-a596-0a623144e808 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.102303 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fc192-8f06-477f-a596-0a623144e808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.120692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-7a7fc192-8f06-477f-a596-0a623144e808 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:59.121906 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7a7fc192-8f06-477f-a596-0a623144e808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:59.129910 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1346/2688] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:59.135104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fa633-6aeb-41e0-9c92-2d82174ff0da None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:59.145236 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fa633-6aeb-41e0-9c92-2d82174ff0da None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:59.150844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302f2df-1dce-4641-86fd-d1a0ac3aa71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:59.151503 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f2df-1dce-4641-86fd-d1a0ac3aa71b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.151825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f2df-1dce-4641-86fd-d1a0ac3aa71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.152111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302f2df-1dce-4641-86fd-d1a0ac3aa71b admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.152844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302f2df-1dce-4641-86fd-d1a0ac3aa71b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:19:59.153161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302f2df-1dce-4641-86fd-d1a0ac3aa71b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:59.154791 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302f2df-1dce-4641-86fd-d1a0ac3aa71b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:59.157408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:59.167128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1343/2689] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:19:59.171534 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fc192-8f06-477f-a596-0a623144e808 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:59.181092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fc192-8f06-477f-a596-0a623144e808 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:59.186024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac0317-6195-4694-ba84-766804e7ea1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:59.186742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac0317-6195-4694-ba84-766804e7ea1f admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.187033 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac0317-6195-4694-ba84-766804e7ea1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.187350 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac0317-6195-4694-ba84-766804e7ea1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.188075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac0317-6195-4694-ba84-766804e7ea1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:59.189992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac0317-6195-4694-ba84-766804e7ea1f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:59.330805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1347/2690] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:59 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:59.335809 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302f2df-1dce-4641-86fd-d1a0ac3aa71b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:59.345801 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302f2df-1dce-4641-86fd-d1a0ac3aa71b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:59.403834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acf7aa-8a1f-4d36-a043-cc8942a6273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:59.404422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acf7aa-8a1f-4d36-a043-cc8942a6273d admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.404706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acf7aa-8a1f-4d36-a043-cc8942a6273d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.404983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acf7aa-8a1f-4d36-a043-cc8942a6273d admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.405684 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acf7aa-8a1f-4d36-a043-cc8942a6273d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:59.407618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acf7aa-8a1f-4d36-a043-cc8942a6273d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:59.501530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1344/2691] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:59 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:59.505695 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac0317-6195-4694-ba84-766804e7ea1f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:59.517007 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac0317-6195-4694-ba84-766804e7ea1f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:59.521816 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74a962-6d36-4b0a-b66f-22b836e6fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:59.522533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74a962-6d36-4b0a-b66f-22b836e6fc00 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.522823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74a962-6d36-4b0a-b66f-22b836e6fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.523089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74a962-6d36-4b0a-b66f-22b836e6fc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.523830 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74a962-6d36-4b0a-b66f-22b836e6fc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:59.525441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c74a962-6d36-4b0a-b66f-22b836e6fc00 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:59.535861 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1348/2692] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:19:59.539967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acf7aa-8a1f-4d36-a043-cc8942a6273d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:59.549916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acf7aa-8a1f-4d36-a043-cc8942a6273d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:59.555762 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5dfba0-9cfd-445f-a8da-fa3f3f8d223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:59.556425 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dfba0-9cfd-445f-a8da-fa3f3f8d223f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.556702 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dfba0-9cfd-445f-a8da-fa3f3f8d223f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.556985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5dfba0-9cfd-445f-a8da-fa3f3f8d223f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.557723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5dfba0-9cfd-445f-a8da-fa3f3f8d223f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:59.559335 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5dfba0-9cfd-445f-a8da-fa3f3f8d223f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:59.569434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1345/2693] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:19:59.574484 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74a962-6d36-4b0a-b66f-22b836e6fc00 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:59.584631 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74a962-6d36-4b0a-b66f-22b836e6fc00 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:59.589641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63ffee-ab10-4388-b1d3-4fa21d83ca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:59.590583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ffee-ab10-4388-b1d3-4fa21d83ca89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.590875 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ffee-ab10-4388-b1d3-4fa21d83ca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.591179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ffee-ab10-4388-b1d3-4fa21d83ca89 admin admin] PATH_INFO: `/v3/projects/d8221dc370cd42f7827e4fe98f7ea6e6/users/396b58f45e9940c4b1ef1cb0a8e6de4e/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.605896 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63ffee-ab10-4388-b1d3-4fa21d83ca89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8221dc370cd42f7827e4fe98f7ea6e6, user_id=396b58f45e9940c4b1ef1cb0a8e6de4e, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:59.608611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63ffee-ab10-4388-b1d3-4fa21d83ca89 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:59.665964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1349/2694] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:19:59 2022] PUT /identity/v3/projects/d8221dc370cd42f7827e4fe98f7ea6e6/users/396b58f45e9940c4b1ef1cb0a8e6de4e/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:19:59.676185 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6bf96-3bf4-4d23-996d-61fc658daa4c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.676485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6bf96-3bf4-4d23-996d-61fc658daa4c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.676774 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6bf96-3bf4-4d23-996d-61fc658daa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.704455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8aa6bf96-3bf4-4d23-996d-61fc658daa4c None None] MFA Rules not processed for user `396b58f45e9940c4b1ef1cb0a8e6de4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:19:59.705663 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8aa6bf96-3bf4-4d23-996d-61fc658daa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:59.775862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1346/2695] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:19:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:19:59.780339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63ffee-ab10-4388-b1d3-4fa21d83ca89 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:59.818340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:59.848162 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63ffee-ab10-4388-b1d3-4fa21d83ca89 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:59.853377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aed58-e425-4f91-a910-fbd7f47d4cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:59.854151 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aed58-e425-4f91-a910-fbd7f47d4cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.854436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aed58-e425-4f91-a910-fbd7f47d4cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.854711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aed58-e425-4f91-a910-fbd7f47d4cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.855412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189aed58-e425-4f91-a910-fbd7f47d4cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:59.861165 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189aed58-e425-4f91-a910-fbd7f47d4cf5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:59.861806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6bf96-3bf4-4d23-996d-61fc658daa4c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:59.864628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8aa6bf96-3bf4-4d23-996d-61fc658daa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:19:59.931173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6bf96-3bf4-4d23-996d-61fc658daa4c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:59.935868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98abcad-6428-4702-8e1c-238a0957d529 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77832f43876547748b1e34c83c4952c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ab319b3b25470d827d29f5473f359e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:59.936533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98abcad-6428-4702-8e1c-238a0957d529 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.936825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98abcad-6428-4702-8e1c-238a0957d529 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.937109 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98abcad-6428-4702-8e1c-238a0957d529 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.937841 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98abcad-6428-4702-8e1c-238a0957d529 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:19:59.938158 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98abcad-6428-4702-8e1c-238a0957d529 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:59.939827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98abcad-6428-4702-8e1c-238a0957d529 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:59.946678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:19:59.952005 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1347/2696] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:19:59.962246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98abcad-6428-4702-8e1c-238a0957d529 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:19:59.965676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98abcad-6428-4702-8e1c-238a0957d529 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:19:59.970401 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd940ee6-f8f9-47fe-ad26-d4fed888d544 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77832f43876547748b1e34c83c4952c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ab319b3b25470d827d29f5473f359e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:19:59.971037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd940ee6-f8f9-47fe-ad26-d4fed888d544 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:19:59.971328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd940ee6-f8f9-47fe-ad26-d4fed888d544 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:19:59.971645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd940ee6-f8f9-47fe-ad26-d4fed888d544 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:19:59.972337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd940ee6-f8f9-47fe-ad26-d4fed888d544 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:19:59.974277 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd940ee6-f8f9-47fe-ad26-d4fed888d544 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:19:59.988350 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1350/2697] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:59 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:19:59.992698 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aed58-e425-4f91-a910-fbd7f47d4cf5 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:00.054939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aed58-e425-4f91-a910-fbd7f47d4cf5 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:00.059692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d529437-8d69-445a-b9b6-d943ae1902ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:00.060387 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d529437-8d69-445a-b9b6-d943ae1902ad admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:00.060659 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d529437-8d69-445a-b9b6-d943ae1902ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:00.060932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d529437-8d69-445a-b9b6-d943ae1902ad admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:00.061618 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d529437-8d69-445a-b9b6-d943ae1902ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:00.063516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d529437-8d69-445a-b9b6-d943ae1902ad admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:00.070006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1348/2698] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:19:59 2022] POST /identity/v3/projects => generated 354 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:00.074280 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd940ee6-f8f9-47fe-ad26-d4fed888d544 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:00.139058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1351/2699] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:19:59 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:00.139296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd940ee6-f8f9-47fe-ad26-d4fed888d544 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:00.140218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d529437-8d69-445a-b9b6-d943ae1902ad admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:00.142001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047069f9-a274-4501-88b1-28a082f4fd69 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77832f43876547748b1e34c83c4952c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ab319b3b25470d827d29f5473f359e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:00.142693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047069f9-a274-4501-88b1-28a082f4fd69 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:00.142984 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047069f9-a274-4501-88b1-28a082f4fd69 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:00.143268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047069f9-a274-4501-88b1-28a082f4fd69 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:00.144316 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047069f9-a274-4501-88b1-28a082f4fd69 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:20:00.144634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047069f9-a274-4501-88b1-28a082f4fd69 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:00.146268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047069f9-a274-4501-88b1-28a082f4fd69 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:00.151166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d529437-8d69-445a-b9b6-d943ae1902ad admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:00.165115 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1349/2700] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:20:00.197787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047069f9-a274-4501-88b1-28a082f4fd69 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:00.208073 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047069f9-a274-4501-88b1-28a082f4fd69 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:00.213551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77832f43876547748b1e34c83c4952c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54ab319b3b25470d827d29f5473f359e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:00.213978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c851ae-5caf-4216-a49d-1e2e11be9062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:00.214397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:00.214653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c851ae-5caf-4216-a49d-1e2e11be9062 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:00.214753 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:00.214953 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] PATH_INFO: `/v3/projects/0ef1e9754b4c492091c9de6d0456b6d4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:00.215070 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c851ae-5caf-4216-a49d-1e2e11be9062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:00.215276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c851ae-5caf-4216-a49d-1e2e11be9062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:00.216058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c851ae-5caf-4216-a49d-1e2e11be9062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:00.216179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ef1e9754b4c492091c9de6d0456b6d4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:00.217666 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c851ae-5caf-4216-a49d-1e2e11be9062 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:00.218058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:00.228170 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1352/2701] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:00.231832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c851ae-5caf-4216-a49d-1e2e11be9062 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:00.241923 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c851ae-5caf-4216-a49d-1e2e11be9062 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:00.246811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82e85e-9cd1-4e59-bbbc-3897e28a7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:00.247720 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82e85e-9cd1-4e59-bbbc-3897e28a7d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:00.248032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82e85e-9cd1-4e59-bbbc-3897e28a7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:00.248310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82e85e-9cd1-4e59-bbbc-3897e28a7d1d admin admin] PATH_INFO: `/v3/projects/80eed860bac64a4fab0ea455b865bd20/users/6499b91ea4804ac090eba1c24678036f/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:00.264141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82e85e-9cd1-4e59-bbbc-3897e28a7d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=80eed860bac64a4fab0ea455b865bd20, user_id=6499b91ea4804ac090eba1c24678036f, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:00.266812 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82e85e-9cd1-4e59-bbbc-3897e28a7d1d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:00.334961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1353/2702] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:00 2022] PUT /identity/v3/projects/80eed860bac64a4fab0ea455b865bd20/users/6499b91ea4804ac090eba1c24678036f/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:00.339260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82e85e-9cd1-4e59-bbbc-3897e28a7d1d admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:00.344210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef1e9754b4c492091c9de6d0456b6d4', 'request_id': 'req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:00.350470 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef1e9754b4c492091c9de6d0456b6d4', 'request_id': 'req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:00.358170 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef1e9754b4c492091c9de6d0456b6d4', 'request_id': 'req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:00.358751 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:00.400606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82e85e-9cd1-4e59-bbbc-3897e28a7d1d admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:00.408969 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] The token cache is being invalidate because project 0ef1e9754b4c492091c9de6d0456b6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:00.409233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:00.409897 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:00.411544 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1350/2703] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:00 2022] DELETE /identity/v3/projects/0ef1e9754b4c492091c9de6d0456b6d4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:00.461861 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedeb5bd-b895-4df0-b862-69fe2cd98619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:00.461861 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeb5bd-b895-4df0-b862-69fe2cd98619 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:00.461861 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeb5bd-b895-4df0-b862-69fe2cd98619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:00.461861 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedeb5bd-b895-4df0-b862-69fe2cd98619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:00.462391 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedeb5bd-b895-4df0-b862-69fe2cd98619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:00.462573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedeb5bd-b895-4df0-b862-69fe2cd98619 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:00.472397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1354/2704] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:00.477119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:00.478538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:00.492522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787ef71-aa6d-4cea-bd16-f8a74ecd5908 tempest-VolumeQuotaClassesTest-1620209305 tempest-VolumeQuotaClassesTest-1620209305-project-admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:00.497187 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af717c-bd43-4ff7-8690-3ad475f0e338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:00.498068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af717c-bd43-4ff7-8690-3ad475f0e338 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:00.498354 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af717c-bd43-4ff7-8690-3ad475f0e338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:00.498634 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af717c-bd43-4ff7-8690-3ad475f0e338 admin admin] PATH_INFO: `/v3/projects/80eed860bac64a4fab0ea455b865bd20/users/6499b91ea4804ac090eba1c24678036f/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:00.500635 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af717c-bd43-4ff7-8690-3ad475f0e338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80eed860bac64a4fab0ea455b865bd20, user_id=6499b91ea4804ac090eba1c24678036f, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:00.503258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af717c-bd43-4ff7-8690-3ad475f0e338 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:00.513827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1351/2705] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:00 2022] PUT /identity/v3/projects/80eed860bac64a4fab0ea455b865bd20/users/6499b91ea4804ac090eba1c24678036f/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:00.526004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fd6d3-816e-4019-a224-f5f7b3f5d3b9 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:00.526390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fd6d3-816e-4019-a224-f5f7b3f5d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:00.526723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fd6d3-816e-4019-a224-f5f7b3f5d3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:00.555944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-561fd6d3-816e-4019-a224-f5f7b3f5d3b9 None None] MFA Rules not processed for user `6499b91ea4804ac090eba1c24678036f`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:00.557249 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-561fd6d3-816e-4019-a224-f5f7b3f5d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:00.624582 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1355/2706] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:00.636133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af717c-bd43-4ff7-8690-3ad475f0e338 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:00.637983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-58af717c-bd43-4ff7-8690-3ad475f0e338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:00.681902 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:00.695914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af717c-bd43-4ff7-8690-3ad475f0e338 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:00.699664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e4737-acf5-482a-96fc-410ec3f0fcc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:00.700317 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e4737-acf5-482a-96fc-410ec3f0fcc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:00.700610 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e4737-acf5-482a-96fc-410ec3f0fcc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:00.700895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e4737-acf5-482a-96fc-410ec3f0fcc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:00.710000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e4737-acf5-482a-96fc-410ec3f0fcc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:00.712346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e4737-acf5-482a-96fc-410ec3f0fcc5 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:00.721877 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1352/2707] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:01.030523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fd6d3-816e-4019-a224-f5f7b3f5d3b9 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:01.031966 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-561fd6d3-816e-4019-a224-f5f7b3f5d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:01.082062 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:01.098688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fd6d3-816e-4019-a224-f5f7b3f5d3b9 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:01.104575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:01.105708 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:01.105996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:01.106280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] PATH_INFO: `/v3/users/96e7af8abba545708c5304b38e9e0b3c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:01.107487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e7af8abba545708c5304b38e9e0b3c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:01.109459 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:01.343951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e7af8abba545708c5304b38e9e0b3c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:01.356242 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e7af8abba545708c5304b38e9e0b3c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:01.356924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e7af8abba545708c5304b38e9e0b3c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:01.363834 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e7af8abba545708c5304b38e9e0b3c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:01.364467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e7af8abba545708c5304b38e9e0b3c'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:01.489728 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1356/2708] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:01 2022] DELETE /identity/v3/users/96e7af8abba545708c5304b38e9e0b3c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:01.494290 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ef3c8-0d80-4bde-ba4d-b0f5e610e7bc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:01.494789 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ef3c8-0d80-4bde-ba4d-b0f5e610e7bc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:01.494909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ef3c8-0d80-4bde-ba4d-b0f5e610e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:01.513094 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f53ef3c8-0d80-4bde-ba4d-b0f5e610e7bc None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:01.514212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f53ef3c8-0d80-4bde-ba4d-b0f5e610e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:01.578818 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1353/2709] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:01.589233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:01.590634 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:01.649335 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee3f3d-54dc-42ed-9b6a-41860c14c4b5 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:01.652971 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f2af8-19e9-4ec8-a4ca-c1c0c3e0bf6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:01.653645 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f2af8-19e9-4ec8-a4ca-c1c0c3e0bf6d service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:01.653903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f2af8-19e9-4ec8-a4ca-c1c0c3e0bf6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:01.654180 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f2af8-19e9-4ec8-a4ca-c1c0c3e0bf6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:01.663661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f2af8-19e9-4ec8-a4ca-c1c0c3e0bf6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:01.665319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f2af8-19e9-4ec8-a4ca-c1c0c3e0bf6d service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:01.675569 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1357/2710] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:01.818484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ef3c8-0d80-4bde-ba4d-b0f5e610e7bc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:01.820518 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f53ef3c8-0d80-4bde-ba4d-b0f5e610e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:01.832103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ef3c8-0d80-4bde-ba4d-b0f5e610e7bc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:01.837119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f29c4-ea87-4c72-a74b-7d61dac8bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:01.837986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f29c4-ea87-4c72-a74b-7d61dac8bc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:01.838282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f29c4-ea87-4c72-a74b-7d61dac8bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:01.838531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f29c4-ea87-4c72-a74b-7d61dac8bc77 admin admin] PATH_INFO: `/v3/users/396b58f45e9940c4b1ef1cb0a8e6de4e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:01.839741 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f29c4-ea87-4c72-a74b-7d61dac8bc77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=396b58f45e9940c4b1ef1cb0a8e6de4e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:01.841652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f29c4-ea87-4c72-a74b-7d61dac8bc77 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:02.007558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fa4f29c4-ea87-4c72-a74b-7d61dac8bc77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396b58f45e9940c4b1ef1cb0a8e6de4e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.068539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f2af8-19e9-4ec8-a4ca-c1c0c3e0bf6d service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:02.070009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ff6f2af8-19e9-4ec8-a4ca-c1c0c3e0bf6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:02.084291 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fa4f29c4-ea87-4c72-a74b-7d61dac8bc77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396b58f45e9940c4b1ef1cb0a8e6de4e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.085051 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f2af8-19e9-4ec8-a4ca-c1c0c3e0bf6d service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:02.089893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:02.096044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:02.096044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:02.096044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] PATH_INFO: `/v3/projects/fbc29090e7304a7fa2d0a76fb572708f` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:02.096044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc29090e7304a7fa2d0a76fb572708f)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:02.096044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:02.107177 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fa4f29c4-ea87-4c72-a74b-7d61dac8bc77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396b58f45e9940c4b1ef1cb0a8e6de4e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.108159 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fa4f29c4-ea87-4c72-a74b-7d61dac8bc77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396b58f45e9940c4b1ef1cb0a8e6de4e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.108777 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fa4f29c4-ea87-4c72-a74b-7d61dac8bc77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396b58f45e9940c4b1ef1cb0a8e6de4e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.122347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1354/2711] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:01 2022] DELETE /identity/v3/users/396b58f45e9940c4b1ef1cb0a8e6de4e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:02.126725 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1b22b-1495-48c5-bbae-375386bb0604 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:02.127047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1b22b-1495-48c5-bbae-375386bb0604 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:02.127387 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1b22b-1495-48c5-bbae-375386bb0604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:02.144434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0db1b22b-1495-48c5-bbae-375386bb0604 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:02.145644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0db1b22b-1495-48c5-bbae-375386bb0604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:02.193896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:02.199515 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc29090e7304a7fa2d0a76fb572708f', 'request_id': 'req-6e14fb71-95e5-44a0-acdf-8a0ce0920768'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.205668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1355/2712] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:20:02.215326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1b22b-1495-48c5-bbae-375386bb0604 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:02.216839 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0db1b22b-1495-48c5-bbae-375386bb0604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:02.275449 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1b22b-1495-48c5-bbae-375386bb0604 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:02.290599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc29090e7304a7fa2d0a76fb572708f', 'request_id': 'req-6e14fb71-95e5-44a0-acdf-8a0ce0920768'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.297592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc29090e7304a7fa2d0a76fb572708f', 'request_id': 'req-6e14fb71-95e5-44a0-acdf-8a0ce0920768'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.299622 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:02.309586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] The token cache is being invalidate because project fbc29090e7304a7fa2d0a76fb572708f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:02.309878 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.310565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.312351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1358/2713] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:02 2022] DELETE /identity/v3/projects/fbc29090e7304a7fa2d0a76fb572708f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:02.316117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:02.317615 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:02.329105 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f02115-5725-4f75-8a03-5303686fba13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:02.329852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f02115-5725-4f75-8a03-5303686fba13 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:02.331475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f02115-5725-4f75-8a03-5303686fba13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:02.331475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f02115-5725-4f75-8a03-5303686fba13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:02.332312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f4f02115-5725-4f75-8a03-5303686fba13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:02.383279 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14fb71-95e5-44a0-acdf-8a0ce0920768 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:02.388302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:02.389175 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:02.389460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:02.389870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] PATH_INFO: `/v3/users/77832f43876547748b1e34c83c4952c3` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:02.391161 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77832f43876547748b1e34c83c4952c3)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:02.393143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:02.396536 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f02115-5725-4f75-8a03-5303686fba13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:02.401241 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f02115-5725-4f75-8a03-5303686fba13 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:02.408360 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1356/2714] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:20:02.655512 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77832f43876547748b1e34c83c4952c3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.668914 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77832f43876547748b1e34c83c4952c3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.670741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77832f43876547748b1e34c83c4952c3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.676934 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77832f43876547748b1e34c83c4952c3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.677575 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77832f43876547748b1e34c83c4952c3'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:02.749837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1359/2715] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:02 2022] DELETE /identity/v3/users/77832f43876547748b1e34c83c4952c3 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:02.824519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f02115-5725-4f75-8a03-5303686fba13 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:02.825964 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f4f02115-5725-4f75-8a03-5303686fba13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:02.838561 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f02115-5725-4f75-8a03-5303686fba13 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:02.899135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:02.900028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:02.900312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:02.900586 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] PATH_INFO: `/v3/projects/d8221dc370cd42f7827e4fe98f7ea6e6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:02.901770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8221dc370cd42f7827e4fe98f7ea6e6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:02.903707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:02.905998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:03.035415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8221dc370cd42f7827e4fe98f7ea6e6', 'request_id': 'req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.041999 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8221dc370cd42f7827e4fe98f7ea6e6', 'request_id': 'req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.048418 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8221dc370cd42f7827e4fe98f7ea6e6', 'request_id': 'req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.129909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] The token cache is being invalidate because project d8221dc370cd42f7827e4fe98f7ea6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:03.130164 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.130770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.132895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1357/2716] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:02 2022] DELETE /identity/v3/projects/d8221dc370cd42f7827e4fe98f7ea6e6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:03.137457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:03.138860 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:03.153320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56dd32-ee2a-459c-a88e-163060aecac0 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:03.183483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:03.185139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:03.219351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0043533-9165-422a-a1c3-b33b59bd7aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:03.220267 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043533-9165-422a-a1c3-b33b59bd7aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:03.220551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043533-9165-422a-a1c3-b33b59bd7aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:03.220827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0043533-9165-422a-a1c3-b33b59bd7aa5 admin admin] PATH_INFO: `/v3/users/6499b91ea4804ac090eba1c24678036f` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:03.222012 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0043533-9165-422a-a1c3-b33b59bd7aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6499b91ea4804ac090eba1c24678036f)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:03.224009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0043533-9165-422a-a1c3-b33b59bd7aa5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:03.236893 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:03.267747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdf5f0-25d0-4fcd-b056-2fdc2422ac41 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:03.273208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:03.274083 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:03.274400 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:03.274685 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] PATH_INFO: `/v3/projects/54ab319b3b25470d827d29f5473f359e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:03.276063 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ab319b3b25470d827d29f5473f359e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:03.278021 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:03.412263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ab319b3b25470d827d29f5473f359e', 'request_id': 'req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.412786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a0043533-9165-422a-a1c3-b33b59bd7aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6499b91ea4804ac090eba1c24678036f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.417898 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ab319b3b25470d827d29f5473f359e', 'request_id': 'req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.424035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ab319b3b25470d827d29f5473f359e', 'request_id': 'req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.425452 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a0043533-9165-422a-a1c3-b33b59bd7aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6499b91ea4804ac090eba1c24678036f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.426135 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a0043533-9165-422a-a1c3-b33b59bd7aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6499b91ea4804ac090eba1c24678036f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.434228 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a0043533-9165-422a-a1c3-b33b59bd7aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6499b91ea4804ac090eba1c24678036f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.434870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-a0043533-9165-422a-a1c3-b33b59bd7aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6499b91ea4804ac090eba1c24678036f'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.488759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] The token cache is being invalidate because project 54ab319b3b25470d827d29f5473f359e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:03.489037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.489667 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32a4805b-3d2f-40a1-ae5f-d0ac5aa1d4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:03.491854 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1358/2717] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:03 2022] DELETE /identity/v3/projects/54ab319b3b25470d827d29f5473f359e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:03.497082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002005ac-7fa7-4420-9291-6f06c218845e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:03.497367 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002005ac-7fa7-4420-9291-6f06c218845e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:03.497644 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002005ac-7fa7-4420-9291-6f06c218845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:03.515939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-002005ac-7fa7-4420-9291-6f06c218845e None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:03.517193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-002005ac-7fa7-4420-9291-6f06c218845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:03.530231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1360/2718] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:03 2022] DELETE /identity/v3/users/6499b91ea4804ac090eba1c24678036f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:03.535826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:03.581142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1359/2719] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:20:03.589614 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7eb0-1091-4bbe-be68-d1abc0864f4f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:03.589903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7eb0-1091-4bbe-be68-d1abc0864f4f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:03.590186 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de7eb0-1091-4bbe-be68-d1abc0864f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:03.609688 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-40de7eb0-1091-4bbe-be68-d1abc0864f4f None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:03.611065 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-40de7eb0-1091-4bbe-be68-d1abc0864f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:03.673355 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1361/2720] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:20:03.677728 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002005ac-7fa7-4420-9291-6f06c218845e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:03.688530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002005ac-7fa7-4420-9291-6f06c218845e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:03.693246 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a208e-87ab-4487-8ae9-59f02e8aa821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:03.693950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a208e-87ab-4487-8ae9-59f02e8aa821 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:03.694249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a208e-87ab-4487-8ae9-59f02e8aa821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:03.694531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a208e-87ab-4487-8ae9-59f02e8aa821 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:03.695444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a208e-87ab-4487-8ae9-59f02e8aa821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:20:03.695714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a208e-87ab-4487-8ae9-59f02e8aa821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:03.697331 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a208e-87ab-4487-8ae9-59f02e8aa821 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:03.709866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1360/2721] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:20:03.714599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de7eb0-1091-4bbe-be68-d1abc0864f4f None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:03.724095 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de7eb0-1091-4bbe-be68-d1abc0864f4f None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:03.729503 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b102be-38ef-4304-b28c-bc191e89a6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:03.730172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b102be-38ef-4304-b28c-bc191e89a6a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:03.730460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b102be-38ef-4304-b28c-bc191e89a6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:03.730741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b102be-38ef-4304-b28c-bc191e89a6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:03.731442 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b102be-38ef-4304-b28c-bc191e89a6a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:03.733398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b102be-38ef-4304-b28c-bc191e89a6a4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:03.799739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1362/2722] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:20:03 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:20:03.804205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a208e-87ab-4487-8ae9-59f02e8aa821 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:03.814565 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a208e-87ab-4487-8ae9-59f02e8aa821 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:03.876464 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205f122-fd9b-434b-824f-212546a675b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:03.877214 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205f122-fd9b-434b-824f-212546a675b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:03.877537 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205f122-fd9b-434b-824f-212546a675b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:03.877824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205f122-fd9b-434b-824f-212546a675b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:03.878533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205f122-fd9b-434b-824f-212546a675b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:03.880502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205f122-fd9b-434b-824f-212546a675b2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:03.960722 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b102be-38ef-4304-b28c-bc191e89a6a4 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:03.962588 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-36b102be-38ef-4304-b28c-bc191e89a6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:03.972113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1361/2723] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:20:03 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:20:03.975958 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205f122-fd9b-434b-824f-212546a675b2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:03.977811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b102be-38ef-4304-b28c-bc191e89a6a4 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:03.982827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:03.983890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:03.984171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:03.984458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] PATH_INFO: `/v3/projects/80eed860bac64a4fab0ea455b865bd20` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:03.985680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80eed860bac64a4fab0ea455b865bd20)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:03.987619 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:03.989496 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205f122-fd9b-434b-824f-212546a675b2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:03.995085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d2370-0b52-4c80-9c98-a10f9ee51177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:03.995862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d2370-0b52-4c80-9c98-a10f9ee51177 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:03.996149 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d2370-0b52-4c80-9c98-a10f9ee51177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:03.996433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d2370-0b52-4c80-9c98-a10f9ee51177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:03.997228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d2370-0b52-4c80-9c98-a10f9ee51177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:03.998830 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d2370-0b52-4c80-9c98-a10f9ee51177 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.010744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1362/2724] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:04.014668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d2370-0b52-4c80-9c98-a10f9ee51177 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.025696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d2370-0b52-4c80-9c98-a10f9ee51177 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.032176 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb674dc0-8359-45d1-8422-d0e23efb5e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.032887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb674dc0-8359-45d1-8422-d0e23efb5e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.033161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb674dc0-8359-45d1-8422-d0e23efb5e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.033441 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb674dc0-8359-45d1-8422-d0e23efb5e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.034178 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb674dc0-8359-45d1-8422-d0e23efb5e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.035839 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb674dc0-8359-45d1-8422-d0e23efb5e79 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.048545 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1363/2725] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:04.052595 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb674dc0-8359-45d1-8422-d0e23efb5e79 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.063100 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb674dc0-8359-45d1-8422-d0e23efb5e79 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.067683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c434b63-0468-4a47-87a0-19e7d8f0a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.068547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434b63-0468-4a47-87a0-19e7d8f0a957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.068812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434b63-0468-4a47-87a0-19e7d8f0a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.069086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434b63-0468-4a47-87a0-19e7d8f0a957 admin admin] PATH_INFO: `/v3/projects/ce452afded294685a43552d24bf42a94/users/e763a2c9433f4fac84d331d6a012062d/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.085141 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c434b63-0468-4a47-87a0-19e7d8f0a957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce452afded294685a43552d24bf42a94, user_id=e763a2c9433f4fac84d331d6a012062d, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.087872 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c434b63-0468-4a47-87a0-19e7d8f0a957 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.140857 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1364/2726] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:04 2022] PUT /identity/v3/projects/ce452afded294685a43552d24bf42a94/users/e763a2c9433f4fac84d331d6a012062d/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:04.150015 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80eed860bac64a4fab0ea455b865bd20', 'request_id': 'req-4b2728d5-db79-4eb5-811c-64b719f0aa69'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:04.152945 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dcfb9-7e8d-4f18-8526-e80111545efa None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.153190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dcfb9-7e8d-4f18-8526-e80111545efa None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.153500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0dcfb9-7e8d-4f18-8526-e80111545efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.204522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80eed860bac64a4fab0ea455b865bd20', 'request_id': 'req-4b2728d5-db79-4eb5-811c-64b719f0aa69'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:04.212705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80eed860bac64a4fab0ea455b865bd20', 'request_id': 'req-4b2728d5-db79-4eb5-811c-64b719f0aa69'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:04.215209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:04.224804 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] The token cache is being invalidate because project 80eed860bac64a4fab0ea455b865bd20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:04.225086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:04.225794 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-4b2728d5-db79-4eb5-811c-64b719f0aa69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:04.227421 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1363/2727] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:03 2022] DELETE /identity/v3/projects/80eed860bac64a4fab0ea455b865bd20 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:04.233208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950753-1b11-4a80-bd6f-d409d002ec4d None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.233621 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950753-1b11-4a80-bd6f-d409d002ec4d None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.233909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8950753-1b11-4a80-bd6f-d409d002ec4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.253606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e8950753-1b11-4a80-bd6f-d409d002ec4d None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:04.254954 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e8950753-1b11-4a80-bd6f-d409d002ec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:04.315789 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9f0dcfb9-7e8d-4f18-8526-e80111545efa None None] MFA Rules not processed for user `e763a2c9433f4fac84d331d6a012062d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:04.317068 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9f0dcfb9-7e8d-4f18-8526-e80111545efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:04.320468 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1364/2728] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:20:04.327984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fece17-c26d-429f-af07-472c496b99e2 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.328260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fece17-c26d-429f-af07-472c496b99e2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.328540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fece17-c26d-429f-af07-472c496b99e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.346363 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a2fece17-c26d-429f-af07-472c496b99e2 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:04.348539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a2fece17-c26d-429f-af07-472c496b99e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:04.357144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1365/2729] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:04.360208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:04.361275 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fece17-c26d-429f-af07-472c496b99e2 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.370907 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fece17-c26d-429f-af07-472c496b99e2 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.375640 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcbb43-0115-4143-9684-42ebba7162a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.376292 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcbb43-0115-4143-9684-42ebba7162a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.376578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcbb43-0115-4143-9684-42ebba7162a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.376859 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcbb43-0115-4143-9684-42ebba7162a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.377585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcbb43-0115-4143-9684-42ebba7162a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:20:04.377898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcbb43-0115-4143-9684-42ebba7162a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.379516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcbb43-0115-4143-9684-42ebba7162a6 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.386389 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1365/2730] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:20:04.387424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dcfb9-7e8d-4f18-8526-e80111545efa None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.388794 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9f0dcfb9-7e8d-4f18-8526-e80111545efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:04.392058 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1366/2731] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:20:04.396215 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcbb43-0115-4143-9684-42ebba7162a6 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.402911 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0dcfb9-7e8d-4f18-8526-e80111545efa None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.405966 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcbb43-0115-4143-9684-42ebba7162a6 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.407556 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40442bb3-d0a3-4871-b6fd-57389d7a6e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.413648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40442bb3-d0a3-4871-b6fd-57389d7a6e67 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.413648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40442bb3-d0a3-4871-b6fd-57389d7a6e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.413648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40442bb3-d0a3-4871-b6fd-57389d7a6e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.413648 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40442bb3-d0a3-4871-b6fd-57389d7a6e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.414137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667b1a8-0b1b-4047-bc6d-fa2ec6db8a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.414137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667b1a8-0b1b-4047-bc6d-fa2ec6db8a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.414137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667b1a8-0b1b-4047-bc6d-fa2ec6db8a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.414387 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40442bb3-d0a3-4871-b6fd-57389d7a6e67 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.414465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667b1a8-0b1b-4047-bc6d-fa2ec6db8a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.414465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667b1a8-0b1b-4047-bc6d-fa2ec6db8a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.414673 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667b1a8-0b1b-4047-bc6d-fa2ec6db8a83 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.519975 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1366/2732] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:20:04 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:04.524089 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40442bb3-d0a3-4871-b6fd-57389d7a6e67 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.547544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1367/2733] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:20:04 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:04.548815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667b1a8-0b1b-4047-bc6d-fa2ec6db8a83 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.588569 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40442bb3-d0a3-4871-b6fd-57389d7a6e67 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.610063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667b1a8-0b1b-4047-bc6d-fa2ec6db8a83 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.614666 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738ff9a-7952-4276-a5f0-6b1f0fea8a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.615331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738ff9a-7952-4276-a5f0-6b1f0fea8a7a admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.615663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738ff9a-7952-4276-a5f0-6b1f0fea8a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.615916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738ff9a-7952-4276-a5f0-6b1f0fea8a7a admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.617208 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738ff9a-7952-4276-a5f0-6b1f0fea8a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.619193 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738ff9a-7952-4276-a5f0-6b1f0fea8a7a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.650797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e09803-98c6-4edb-a9b0-cbc6b1edf40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.651472 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09803-98c6-4edb-a9b0-cbc6b1edf40d admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.651798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09803-98c6-4edb-a9b0-cbc6b1edf40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.652079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e09803-98c6-4edb-a9b0-cbc6b1edf40d admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.652768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e09803-98c6-4edb-a9b0-cbc6b1edf40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.654678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e09803-98c6-4edb-a9b0-cbc6b1edf40d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.696144 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1368/2734] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:20:04 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:04.699784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738ff9a-7952-4276-a5f0-6b1f0fea8a7a admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.709354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738ff9a-7952-4276-a5f0-6b1f0fea8a7a admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.714838 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ef4ad-d636-49b6-b734-809d7051dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.715473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ef4ad-d636-49b6-b734-809d7051dc32 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.715803 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ef4ad-d636-49b6-b734-809d7051dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.716084 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ef4ad-d636-49b6-b734-809d7051dc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.716800 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ef4ad-d636-49b6-b734-809d7051dc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.718439 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ef4ad-d636-49b6-b734-809d7051dc32 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.729320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1369/2735] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:04.732902 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ef4ad-d636-49b6-b734-809d7051dc32 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.742470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ef4ad-d636-49b6-b734-809d7051dc32 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.747104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf9dfb-88d7-436d-bebd-5ee8df0c8a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.747756 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf9dfb-88d7-436d-bebd-5ee8df0c8a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.748044 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf9dfb-88d7-436d-bebd-5ee8df0c8a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.748328 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf9dfb-88d7-436d-bebd-5ee8df0c8a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.749024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf9dfb-88d7-436d-bebd-5ee8df0c8a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.750553 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf9dfb-88d7-436d-bebd-5ee8df0c8a39 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.758768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1367/2736] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:20:04 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:20:04.762643 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1370/2737] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:04.765098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf9dfb-88d7-436d-bebd-5ee8df0c8a39 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.765256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e09803-98c6-4edb-a9b0-cbc6b1edf40d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.775882 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf9dfb-88d7-436d-bebd-5ee8df0c8a39 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.776332 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e09803-98c6-4edb-a9b0-cbc6b1edf40d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.780437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbb31b-84fa-490f-9979-6794f8d8e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.785455 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a348a-168e-4836-a5ec-5fd99e01ca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.785590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb31b-84fa-490f-9979-6794f8d8e70a admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.785590 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb31b-84fa-490f-9979-6794f8d8e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.785806 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a348a-168e-4836-a5ec-5fd99e01ca02 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.785901 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb31b-84fa-490f-9979-6794f8d8e70a admin admin] PATH_INFO: `/v3/projects/3dcb623eb98e4920bdd28140b3c1c5c8/users/54479325f5a544d49d90bd68a549b7a8/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.785994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a348a-168e-4836-a5ec-5fd99e01ca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.785994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a348a-168e-4836-a5ec-5fd99e01ca02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.785994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a348a-168e-4836-a5ec-5fd99e01ca02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.785994 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a348a-168e-4836-a5ec-5fd99e01ca02 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.796263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1368/2738] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:04.800124 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a348a-168e-4836-a5ec-5fd99e01ca02 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.801902 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbb31b-84fa-490f-9979-6794f8d8e70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcb623eb98e4920bdd28140b3c1c5c8, user_id=54479325f5a544d49d90bd68a549b7a8, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.804987 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbb31b-84fa-490f-9979-6794f8d8e70a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.809759 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:04.810082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a348a-168e-4836-a5ec-5fd99e01ca02 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.814812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4174e72-a47e-4d63-b827-d4619487c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.815523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4174e72-a47e-4d63-b827-d4619487c2ed admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.815848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4174e72-a47e-4d63-b827-d4619487c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.816133 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4174e72-a47e-4d63-b827-d4619487c2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.816855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4174e72-a47e-4d63-b827-d4619487c2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.818488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4174e72-a47e-4d63-b827-d4619487c2ed admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.829337 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1369/2739] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:04.833313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4174e72-a47e-4d63-b827-d4619487c2ed admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.842996 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4174e72-a47e-4d63-b827-d4619487c2ed admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:04.847747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184720f-ff72-444e-b47c-3ef9b288e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:04.848921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184720f-ff72-444e-b47c-3ef9b288e97d admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.848921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184720f-ff72-444e-b47c-3ef9b288e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.849175 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184720f-ff72-444e-b47c-3ef9b288e97d admin admin] PATH_INFO: `/v3/projects/32a897637b2347069e7f27ac8676cb21/users/8db00a560f8c4cdba0b7e367cd6a3b51/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.864687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184720f-ff72-444e-b47c-3ef9b288e97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a897637b2347069e7f27ac8676cb21, user_id=8db00a560f8c4cdba0b7e367cd6a3b51, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:04.868275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184720f-ff72-444e-b47c-3ef9b288e97d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:04.868797 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1371/2740] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:04 2022] PUT /identity/v3/projects/3dcb623eb98e4920bdd28140b3c1c5c8/users/54479325f5a544d49d90bd68a549b7a8/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:04.878936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6742ab-ffeb-4758-a8e2-099a7e72817f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.883304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6742ab-ffeb-4758-a8e2-099a7e72817f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.883304 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6742ab-ffeb-4758-a8e2-099a7e72817f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.905864 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-ce6742ab-ffeb-4758-a8e2-099a7e72817f None None] MFA Rules not processed for user `54479325f5a544d49d90bd68a549b7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:04.907108 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ce6742ab-ffeb-4758-a8e2-099a7e72817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:04.954405 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1370/2741] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:04 2022] PUT /identity/v3/projects/32a897637b2347069e7f27ac8676cb21/users/8db00a560f8c4cdba0b7e367cd6a3b51/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:04.966363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d090a-2040-4be7-954f-b9adff3afe77 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:04.966743 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d090a-2040-4be7-954f-b9adff3afe77 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:04.967102 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d090a-2040-4be7-954f-b9adff3afe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:04.971540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1372/2742] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:20:04.983423 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6742ab-ffeb-4758-a8e2-099a7e72817f None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:04.985121 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ce6742ab-ffeb-4758-a8e2-099a7e72817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:04.989345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:04.997361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-692d090a-2040-4be7-954f-b9adff3afe77 None None] MFA Rules not processed for user `8db00a560f8c4cdba0b7e367cd6a3b51`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:05.001532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-692d090a-2040-4be7-954f-b9adff3afe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:05.045052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6742ab-ffeb-4758-a8e2-099a7e72817f None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:05.067523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1371/2743] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:05.072165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d090a-2040-4be7-954f-b9adff3afe77 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:05.097505 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362826d8-f7ea-4ad6-bef1-3d84d317453f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:05.098168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362826d8-f7ea-4ad6-bef1-3d84d317453f service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:05.098451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362826d8-f7ea-4ad6-bef1-3d84d317453f service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:05.098734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362826d8-f7ea-4ad6-bef1-3d84d317453f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:05.135127 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d090a-2040-4be7-954f-b9adff3afe77 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:05.140345 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51298d1-0592-45a3-bd6f-b9d92e570a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:05.140995 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51298d1-0592-45a3-bd6f-b9d92e570a54 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:05.141277 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51298d1-0592-45a3-bd6f-b9d92e570a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:05.141558 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51298d1-0592-45a3-bd6f-b9d92e570a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:05.142242 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51298d1-0592-45a3-bd6f-b9d92e570a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:05.144458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51298d1-0592-45a3-bd6f-b9d92e570a54 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:05.155647 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:05.159101 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362826d8-f7ea-4ad6-bef1-3d84d317453f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:05.160583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362826d8-f7ea-4ad6-bef1-3d84d317453f service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:05.170191 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1373/2744] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:20:05.225012 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1372/2745] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:20:05 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:05.227231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362826d8-f7ea-4ad6-bef1-3d84d317453f service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:05.239075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362826d8-f7ea-4ad6-bef1-3d84d317453f service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:05.301389 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfccbe-eb5c-4251-ba3b-c3f6321e4696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:05.302061 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfccbe-eb5c-4251-ba3b-c3f6321e4696 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:05.302331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfccbe-eb5c-4251-ba3b-c3f6321e4696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:05.302604 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfccbe-eb5c-4251-ba3b-c3f6321e4696 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:05.303429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfccbe-eb5c-4251-ba3b-c3f6321e4696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:05.306172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfccbe-eb5c-4251-ba3b-c3f6321e4696 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:05.375170 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1374/2746] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:20:05 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:05.379361 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51298d1-0592-45a3-bd6f-b9d92e570a54 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:05.390351 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51298d1-0592-45a3-bd6f-b9d92e570a54 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:05.395431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b0c18-68c0-49ca-9bbd-6be0e308a6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:05.396108 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b0c18-68c0-49ca-9bbd-6be0e308a6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:05.396391 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b0c18-68c0-49ca-9bbd-6be0e308a6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:05.396735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b0c18-68c0-49ca-9bbd-6be0e308a6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:05.397955 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b0c18-68c0-49ca-9bbd-6be0e308a6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:05.399639 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b0c18-68c0-49ca-9bbd-6be0e308a6a1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:05.409706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1373/2747] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:05.414715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfccbe-eb5c-4251-ba3b-c3f6321e4696 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:05.424927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfccbe-eb5c-4251-ba3b-c3f6321e4696 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:05.429738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13690b98-b5f0-49bc-9031-14484757c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:05.430611 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13690b98-b5f0-49bc-9031-14484757c21c admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:05.430982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13690b98-b5f0-49bc-9031-14484757c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:05.431263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13690b98-b5f0-49bc-9031-14484757c21c admin admin] PATH_INFO: `/v3/projects/2f3e27ac24c045d6aa90b7ef7af32914/users/3ba31a1b3ed444368790bd218fd41e75/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:05.446154 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13690b98-b5f0-49bc-9031-14484757c21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f3e27ac24c045d6aa90b7ef7af32914, user_id=3ba31a1b3ed444368790bd218fd41e75, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:05.448939 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13690b98-b5f0-49bc-9031-14484757c21c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:05.533368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1375/2748] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:05 2022] PUT /identity/v3/projects/2f3e27ac24c045d6aa90b7ef7af32914/users/3ba31a1b3ed444368790bd218fd41e75/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:05.534579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b0c18-68c0-49ca-9bbd-6be0e308a6a1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:05.544921 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b0c18-68c0-49ca-9bbd-6be0e308a6a1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:05.603844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27413e00-1eae-4f41-ae00-bf3702a77670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:05.604437 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413e00-1eae-4f41-ae00-bf3702a77670 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:05.604712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413e00-1eae-4f41-ae00-bf3702a77670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:05.604981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413e00-1eae-4f41-ae00-bf3702a77670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:05.605724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27413e00-1eae-4f41-ae00-bf3702a77670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:05.607289 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27413e00-1eae-4f41-ae00-bf3702a77670 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:05.617671 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1374/2749] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:05.621898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13690b98-b5f0-49bc-9031-14484757c21c admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:05.632995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13690b98-b5f0-49bc-9031-14484757c21c admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:05.637995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5e8a6-bd83-4167-bd95-5cd23f0f3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:05.638983 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5e8a6-bd83-4167-bd95-5cd23f0f3168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:05.639280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5e8a6-bd83-4167-bd95-5cd23f0f3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:05.639551 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5e8a6-bd83-4167-bd95-5cd23f0f3168 admin admin] PATH_INFO: `/v3/projects/2f3e27ac24c045d6aa90b7ef7af32914/users/3ba31a1b3ed444368790bd218fd41e75/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:05.641719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5e8a6-bd83-4167-bd95-5cd23f0f3168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f3e27ac24c045d6aa90b7ef7af32914, user_id=3ba31a1b3ed444368790bd218fd41e75, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:05.644752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5e8a6-bd83-4167-bd95-5cd23f0f3168 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:05.655451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1376/2750] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:05 2022] PUT /identity/v3/projects/2f3e27ac24c045d6aa90b7ef7af32914/users/3ba31a1b3ed444368790bd218fd41e75/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:05.666028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b849d-fa4d-4b8b-98c8-78a0061f02c2 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:05.666335 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b849d-fa4d-4b8b-98c8-78a0061f02c2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:05.666613 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b849d-fa4d-4b8b-98c8-78a0061f02c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:05.685065 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:05.692465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-861b849d-fa4d-4b8b-98c8-78a0061f02c2 None None] MFA Rules not processed for user `3ba31a1b3ed444368790bd218fd41e75`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:05.693666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-861b849d-fa4d-4b8b-98c8-78a0061f02c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:05.765998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1375/2751] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:05.777098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5e8a6-bd83-4167-bd95-5cd23f0f3168 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:05.834982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5e8a6-bd83-4167-bd95-5cd23f0f3168 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:05.839075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807d9e1-e330-4b70-8b72-c93a6af8a0bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:05.840344 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d9e1-e330-4b70-8b72-c93a6af8a0bc service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:05.840629 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d9e1-e330-4b70-8b72-c93a6af8a0bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:05.840909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807d9e1-e330-4b70-8b72-c93a6af8a0bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:05.851100 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807d9e1-e330-4b70-8b72-c93a6af8a0bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:05.853091 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807d9e1-e330-4b70-8b72-c93a6af8a0bc service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:05.867028 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1377/2752] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:06.970106 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b849d-fa4d-4b8b-98c8-78a0061f02c2 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:06.971023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-861b849d-fa4d-4b8b-98c8-78a0061f02c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:06.982819 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b849d-fa4d-4b8b-98c8-78a0061f02c2 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:06.986454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab84bf-30d8-43d4-8737-07bc4fcb6961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:06.987144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab84bf-30d8-43d4-8737-07bc4fcb6961 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:06.987427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab84bf-30d8-43d4-8737-07bc4fcb6961 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:06.987734 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab84bf-30d8-43d4-8737-07bc4fcb6961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:07.044908 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab84bf-30d8-43d4-8737-07bc4fcb6961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:07.046339 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab84bf-30d8-43d4-8737-07bc4fcb6961 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:07.055797 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1376/2753] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:11.949579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807d9e1-e330-4b70-8b72-c93a6af8a0bc service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:11.958318 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807d9e1-e330-4b70-8b72-c93a6af8a0bc service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:11.961948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaebab5-3946-46ab-b169-53cc4126367a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:11.962585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaebab5-3946-46ab-b169-53cc4126367a service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:11.962867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaebab5-3946-46ab-b169-53cc4126367a service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:11.963145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaebab5-3946-46ab-b169-53cc4126367a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:12.009009 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:12.021118 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaebab5-3946-46ab-b169-53cc4126367a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:12.022497 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaebab5-3946-46ab-b169-53cc4126367a service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:12.025162 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab84bf-30d8-43d4-8737-07bc4fcb6961 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:12.035872 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1378/2754] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:12.088229 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab84bf-30d8-43d4-8737-07bc4fcb6961 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:12.092688 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:12.093548 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:12.093826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:12.094096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] PATH_INFO: `/v3/users/54479325f5a544d49d90bd68a549b7a8` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:12.095270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54479325f5a544d49d90bd68a549b7a8)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:12.097202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:12.295669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:12.305462 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54479325f5a544d49d90bd68a549b7a8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:12.426457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54479325f5a544d49d90bd68a549b7a8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:12.439157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54479325f5a544d49d90bd68a549b7a8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:12.439849 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54479325f5a544d49d90bd68a549b7a8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:12.440466 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54479325f5a544d49d90bd68a549b7a8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:12.453077 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1377/2755] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:12 2022] DELETE /identity/v3/users/54479325f5a544d49d90bd68a549b7a8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:12.457558 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7183c-7baa-4442-85a6-f9e418b765bf None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:12.457859 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7183c-7baa-4442-85a6-f9e418b765bf None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:12.458142 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7183c-7baa-4442-85a6-f9e418b765bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:12.476555 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e9c7183c-7baa-4442-85a6-f9e418b765bf None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:12.481819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e9c7183c-7baa-4442-85a6-f9e418b765bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:12.537320 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1379/2756] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:12.548625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:12.549926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:12.607844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32212a31-ff9d-45c0-8b1d-9872ab1a7008 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:12.611462 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2063276-0467-4166-80f0-2bcfbecc7833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:12.612180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063276-0467-4166-80f0-2bcfbecc7833 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:12.612513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063276-0467-4166-80f0-2bcfbecc7833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:12.612823 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2063276-0467-4166-80f0-2bcfbecc7833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:12.622112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2063276-0467-4166-80f0-2bcfbecc7833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:12.623645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2063276-0467-4166-80f0-2bcfbecc7833 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:12.633211 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1378/2757] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:20:13.057809 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7183c-7baa-4442-85a6-f9e418b765bf None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:13.060570 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e9c7183c-7baa-4442-85a6-f9e418b765bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:13.074540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7183c-7baa-4442-85a6-f9e418b765bf None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:13.079196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:13.083288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:13.083288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:13.083288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] PATH_INFO: `/v3/projects/3dcb623eb98e4920bdd28140b3c1c5c8` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:13.083288 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcb623eb98e4920bdd28140b3c1c5c8)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:13.083823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:13.193458 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcb623eb98e4920bdd28140b3c1c5c8', 'request_id': 'req-66645232-1ddd-459b-929e-c35384baccbb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:13.288807 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcb623eb98e4920bdd28140b3c1c5c8', 'request_id': 'req-66645232-1ddd-459b-929e-c35384baccbb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:13.295642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcb623eb98e4920bdd28140b3c1c5c8', 'request_id': 'req-66645232-1ddd-459b-929e-c35384baccbb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:13.306908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] The token cache is being invalidate because project 3dcb623eb98e4920bdd28140b3c1c5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:13.307203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:13.307874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-66645232-1ddd-459b-929e-c35384baccbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:13.309419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1380/2758] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:13 2022] DELETE /identity/v3/projects/3dcb623eb98e4920bdd28140b3c1c5c8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:13.314332 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3954c3-c964-4a47-84bb-5749fe7b1309 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:13.314919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3954c3-c964-4a47-84bb-5749fe7b1309 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:13.315022 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3954c3-c964-4a47-84bb-5749fe7b1309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:13.333678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3e3954c3-c964-4a47-84bb-5749fe7b1309 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:13.334811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3e3954c3-c964-4a47-84bb-5749fe7b1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:13.403786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1379/2759] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:13.412274 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e26fef-cbc1-4772-9ad1-bdfdc23bd3da None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:13.412690 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e26fef-cbc1-4772-9ad1-bdfdc23bd3da None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:13.412982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e26fef-cbc1-4772-9ad1-bdfdc23bd3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:13.434757 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-d3e26fef-cbc1-4772-9ad1-bdfdc23bd3da None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:13.436086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d3e26fef-cbc1-4772-9ad1-bdfdc23bd3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:13.444438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1381/2760] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:13.450107 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3954c3-c964-4a47-84bb-5749fe7b1309 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:13.460104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3954c3-c964-4a47-84bb-5749fe7b1309 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:13.465473 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66973b4a-2e8c-415b-85a7-71ee8caaaae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:13.466137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66973b4a-2e8c-415b-85a7-71ee8caaaae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:13.466430 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66973b4a-2e8c-415b-85a7-71ee8caaaae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:13.466708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66973b4a-2e8c-415b-85a7-71ee8caaaae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:13.467431 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66973b4a-2e8c-415b-85a7-71ee8caaaae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:20:13.468196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66973b4a-2e8c-415b-85a7-71ee8caaaae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:13.469373 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66973b4a-2e8c-415b-85a7-71ee8caaaae9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:13.481620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1380/2761] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:20:13.485869 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e26fef-cbc1-4772-9ad1-bdfdc23bd3da None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:13.496652 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e26fef-cbc1-4772-9ad1-bdfdc23bd3da None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:13.502050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0672b89-5ee2-42ae-8400-591918980c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:13.502713 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0672b89-5ee2-42ae-8400-591918980c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:13.509126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0672b89-5ee2-42ae-8400-591918980c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:13.509126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0672b89-5ee2-42ae-8400-591918980c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:13.509126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0672b89-5ee2-42ae-8400-591918980c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:13.509126 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0672b89-5ee2-42ae-8400-591918980c84 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:13.612778 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1382/2762] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:20:13 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:20:13.616190 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66973b4a-2e8c-415b-85a7-71ee8caaaae9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:13.627412 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66973b4a-2e8c-415b-85a7-71ee8caaaae9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:13.671268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:13.685732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765149b3-090f-4b55-a6ca-14f8f9bfaac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:13.687678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765149b3-090f-4b55-a6ca-14f8f9bfaac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:13.687678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765149b3-090f-4b55-a6ca-14f8f9bfaac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:13.687678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765149b3-090f-4b55-a6ca-14f8f9bfaac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:13.687678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765149b3-090f-4b55-a6ca-14f8f9bfaac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:13.689552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765149b3-090f-4b55-a6ca-14f8f9bfaac8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:13.779697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1381/2763] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:20:13 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:20:13.780856 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0672b89-5ee2-42ae-8400-591918980c84 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:13.792251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0672b89-5ee2-42ae-8400-591918980c84 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:13.796972 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09e728-02f1-4f7c-9868-d9c8186e19f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:13.797641 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e728-02f1-4f7c-9868-d9c8186e19f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:13.798080 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e728-02f1-4f7c-9868-d9c8186e19f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:13.802414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09e728-02f1-4f7c-9868-d9c8186e19f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:13.802414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09e728-02f1-4f7c-9868-d9c8186e19f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:13.802414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09e728-02f1-4f7c-9868-d9c8186e19f5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:13.811420 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1383/2764] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:13.818330 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765149b3-090f-4b55-a6ca-14f8f9bfaac8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:13.829136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765149b3-090f-4b55-a6ca-14f8f9bfaac8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:13.833947 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecf424-31be-4bf7-9fc1-e61fccb6ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:13.834599 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecf424-31be-4bf7-9fc1-e61fccb6ad2b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:13.834884 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecf424-31be-4bf7-9fc1-e61fccb6ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:13.835167 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecf424-31be-4bf7-9fc1-e61fccb6ad2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:13.835937 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecf424-31be-4bf7-9fc1-e61fccb6ad2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:13.838188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecf424-31be-4bf7-9fc1-e61fccb6ad2b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:13.849213 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1382/2765] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:13.854430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09e728-02f1-4f7c-9868-d9c8186e19f5 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:13.866842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09e728-02f1-4f7c-9868-d9c8186e19f5 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:13.872187 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e54fd-6c86-48df-be9a-8f045cc6a0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:13.877199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e54fd-6c86-48df-be9a-8f045cc6a0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:13.877199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e54fd-6c86-48df-be9a-8f045cc6a0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:13.877199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e54fd-6c86-48df-be9a-8f045cc6a0c4 admin admin] PATH_INFO: `/v3/projects/8b7ec24e5f5a4a20bb08939c1686afec/users/984db53b0c954eb586702d244a46662d/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:13.889511 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e54fd-6c86-48df-be9a-8f045cc6a0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7ec24e5f5a4a20bb08939c1686afec, user_id=984db53b0c954eb586702d244a46662d, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:13.892189 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e54fd-6c86-48df-be9a-8f045cc6a0c4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:13.992482 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1384/2766] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:13 2022] PUT /identity/v3/projects/8b7ec24e5f5a4a20bb08939c1686afec/users/984db53b0c954eb586702d244a46662d/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:14.003169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a2a9-10eb-4fe5-bcd4-e2baca86ea0b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:14.003482 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a2a9-10eb-4fe5-bcd4-e2baca86ea0b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:14.003803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443a2a9-10eb-4fe5-bcd4-e2baca86ea0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:14.031128 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f443a2a9-10eb-4fe5-bcd4-e2baca86ea0b None None] MFA Rules not processed for user `984db53b0c954eb586702d244a46662d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:14.032424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f443a2a9-10eb-4fe5-bcd4-e2baca86ea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:14.095919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1383/2767] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:20:14.107299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e54fd-6c86-48df-be9a-8f045cc6a0c4 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:14.109046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a19e54fd-6c86-48df-be9a-8f045cc6a0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:14.119003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:14.167174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e54fd-6c86-48df-be9a-8f045cc6a0c4 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:14.170832 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124ad9b-5753-4e57-ad47-9dcc1cbd6d50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:14.171478 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124ad9b-5753-4e57-ad47-9dcc1cbd6d50 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:14.171819 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124ad9b-5753-4e57-ad47-9dcc1cbd6d50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:14.172101 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124ad9b-5753-4e57-ad47-9dcc1cbd6d50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:14.180438 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124ad9b-5753-4e57-ad47-9dcc1cbd6d50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:14.181933 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124ad9b-5753-4e57-ad47-9dcc1cbd6d50 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:14.190924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1385/2768] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:16.013845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443a2a9-10eb-4fe5-bcd4-e2baca86ea0b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:16.015252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f443a2a9-10eb-4fe5-bcd4-e2baca86ea0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:16.080855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443a2a9-10eb-4fe5-bcd4-e2baca86ea0b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:16.085356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:16.086205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:16.086502 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:16.086938 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] PATH_INFO: `/v3/users/e763a2c9433f4fac84d331d6a012062d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:16.088221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e763a2c9433f4fac84d331d6a012062d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:16.090114 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:16.252986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e763a2c9433f4fac84d331d6a012062d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:16.312292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e763a2c9433f4fac84d331d6a012062d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:16.317539 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:16.331914 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e763a2c9433f4fac84d331d6a012062d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:16.332751 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e763a2c9433f4fac84d331d6a012062d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:16.333560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e763a2c9433f4fac84d331d6a012062d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:16.346541 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1384/2769] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:16 2022] DELETE /identity/v3/users/e763a2c9433f4fac84d331d6a012062d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:16.351030 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c73e0-aab0-4534-9883-e1131fba5f74 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:16.351490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c73e0-aab0-4534-9883-e1131fba5f74 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:16.351610 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c73e0-aab0-4534-9883-e1131fba5f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:16.369936 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-be4c73e0-aab0-4534-9883-e1131fba5f74 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:16.371137 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-be4c73e0-aab0-4534-9883-e1131fba5f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:16.433221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1386/2770] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:16.442827 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:16.444238 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:16.503640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b6e48-2ad4-47a3-93cc-3bca9cbcc89e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:16.507312 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ede1-da24-4853-b7ce-a21ad0339061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:16.507992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ede1-da24-4853-b7ce-a21ad0339061 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:16.508276 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ede1-da24-4853-b7ce-a21ad0339061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:16.508595 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011ede1-da24-4853-b7ce-a21ad0339061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:16.517677 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011ede1-da24-4853-b7ce-a21ad0339061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:16.519363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011ede1-da24-4853-b7ce-a21ad0339061 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:16.532852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1385/2771] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:16.902623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c73e0-aab0-4534-9883-e1131fba5f74 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:16.904218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-be4c73e0-aab0-4534-9883-e1131fba5f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:16.916961 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c73e0-aab0-4534-9883-e1131fba5f74 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:16.921510 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:16.922376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:16.922663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:16.922932 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] PATH_INFO: `/v3/projects/ce452afded294685a43552d24bf42a94` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:16.924195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce452afded294685a43552d24bf42a94)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:16.926239 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:17.038308 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce452afded294685a43552d24bf42a94', 'request_id': 'req-330945f1-e257-449c-8e46-ed6cd97c7ae6'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:17.100752 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce452afded294685a43552d24bf42a94', 'request_id': 'req-330945f1-e257-449c-8e46-ed6cd97c7ae6'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:17.107560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce452afded294685a43552d24bf42a94', 'request_id': 'req-330945f1-e257-449c-8e46-ed6cd97c7ae6'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:17.118487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] The token cache is being invalidate because project ce452afded294685a43552d24bf42a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:17.118784 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:17.119435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:17.121027 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1387/2772] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:16 2022] DELETE /identity/v3/projects/ce452afded294685a43552d24bf42a94 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:17.124998 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ede1-da24-4853-b7ce-a21ad0339061 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:17.134926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011ede1-da24-4853-b7ce-a21ad0339061 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:17.192079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:17.192981 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:17.193268 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:17.193552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] PATH_INFO: `/v3/users/8db00a560f8c4cdba0b7e367cd6a3b51` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:17.194748 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db00a560f8c4cdba0b7e367cd6a3b51)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:17.197518 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:17.343204 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db00a560f8c4cdba0b7e367cd6a3b51'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:17.398433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db00a560f8c4cdba0b7e367cd6a3b51'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:17.412237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db00a560f8c4cdba0b7e367cd6a3b51'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:17.412926 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db00a560f8c4cdba0b7e367cd6a3b51'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:17.413542 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db00a560f8c4cdba0b7e367cd6a3b51'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:17.419055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:17.427346 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1386/2773] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:17 2022] DELETE /identity/v3/users/8db00a560f8c4cdba0b7e367cd6a3b51 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:17.931571 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:17.933045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:17.950608 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330945f1-e257-449c-8e46-ed6cd97c7ae6 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:17.980280 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:18.006705 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:18.007760 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:18.007924 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:18.008257 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] PATH_INFO: `/v3/projects/32a897637b2347069e7f27ac8676cb21` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:18.009579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a897637b2347069e7f27ac8676cb21)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:18.011525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:18.139568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a897637b2347069e7f27ac8676cb21', 'request_id': 'req-0d0b2c1e-240f-4dad-a645-42110393686d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:18.242742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a897637b2347069e7f27ac8676cb21', 'request_id': 'req-0d0b2c1e-240f-4dad-a645-42110393686d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:18.249854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a897637b2347069e7f27ac8676cb21', 'request_id': 'req-0d0b2c1e-240f-4dad-a645-42110393686d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:18.260661 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] The token cache is being invalidate because project 32a897637b2347069e7f27ac8676cb21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:18.260957 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:18.261631 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:18.263168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1388/2774] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:17 2022] DELETE /identity/v3/projects/32a897637b2347069e7f27ac8676cb21 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:18.267202 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:18.272742 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:18.282028 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c4456-d69d-427d-afad-8bda29f54421 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:18.338551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2de5ad-81d7-447e-afaf-439bf5c26dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:18.339507 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2de5ad-81d7-447e-afaf-439bf5c26dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:18.339828 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2de5ad-81d7-447e-afaf-439bf5c26dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:18.340121 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2de5ad-81d7-447e-afaf-439bf5c26dc2 admin admin] PATH_INFO: `/v3/users/3ba31a1b3ed444368790bd218fd41e75` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:18.341318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2de5ad-81d7-447e-afaf-439bf5c26dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba31a1b3ed444368790bd218fd41e75)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:18.343352 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2de5ad-81d7-447e-afaf-439bf5c26dc2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:18.531692 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4a2de5ad-81d7-447e-afaf-439bf5c26dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba31a1b3ed444368790bd218fd41e75'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:18.603983 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4a2de5ad-81d7-447e-afaf-439bf5c26dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba31a1b3ed444368790bd218fd41e75'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:18.617191 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4a2de5ad-81d7-447e-afaf-439bf5c26dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba31a1b3ed444368790bd218fd41e75'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:18.618501 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4a2de5ad-81d7-447e-afaf-439bf5c26dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba31a1b3ed444368790bd218fd41e75'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:18.619245 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4a2de5ad-81d7-447e-afaf-439bf5c26dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba31a1b3ed444368790bd218fd41e75'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:18.631179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1387/2775] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:18 2022] DELETE /identity/v3/users/3ba31a1b3ed444368790bd218fd41e75 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:19.063626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:19.063626 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:19.076585 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2c1e-240f-4dad-a645-42110393686d admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:19.138470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:19.139344 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:19.139666 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:19.139949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] PATH_INFO: `/v3/projects/2f3e27ac24c045d6aa90b7ef7af32914` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:19.141244 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f3e27ac24c045d6aa90b7ef7af32914)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:19.143148 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:19.296096 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f3e27ac24c045d6aa90b7ef7af32914', 'request_id': 'req-82f2bfd7-26b2-4887-a882-ed726946747a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:19.364045 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f3e27ac24c045d6aa90b7ef7af32914', 'request_id': 'req-82f2bfd7-26b2-4887-a882-ed726946747a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:19.374573 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f3e27ac24c045d6aa90b7ef7af32914', 'request_id': 'req-82f2bfd7-26b2-4887-a882-ed726946747a'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:19.376486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:19.383779 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] The token cache is being invalidate because project 2f3e27ac24c045d6aa90b7ef7af32914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:19.384072 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:19.384746 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-82f2bfd7-26b2-4887-a882-ed726946747a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:19.386340 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1389/2776] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:19 2022] DELETE /identity/v3/projects/2f3e27ac24c045d6aa90b7ef7af32914 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:19.392427 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441d4a6-a108-4679-b8af-39a1d64aa294 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:19.392913 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441d4a6-a108-4679-b8af-39a1d64aa294 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:19.393025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441d4a6-a108-4679-b8af-39a1d64aa294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:19.410655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6441d4a6-a108-4679-b8af-39a1d64aa294 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:19.411876 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6441d4a6-a108-4679-b8af-39a1d64aa294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:19.472233 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1388/2777] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:20:19.482786 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd7a3b-1c61-4d8f-9a7d-94065bc2e306 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:19.483105 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd7a3b-1c61-4d8f-9a7d-94065bc2e306 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:19.483392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd7a3b-1c61-4d8f-9a7d-94065bc2e306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:19.502592 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-5efd7a3b-1c61-4d8f-9a7d-94065bc2e306 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:19.503835 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5efd7a3b-1c61-4d8f-9a7d-94065bc2e306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:19.512370 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1390/2778] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:19.516783 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441d4a6-a108-4679-b8af-39a1d64aa294 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:19.526836 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441d4a6-a108-4679-b8af-39a1d64aa294 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:19.531459 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4445451-2fa2-4629-ae7c-7dec9cc26a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:19.532147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4445451-2fa2-4629-ae7c-7dec9cc26a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:19.532429 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4445451-2fa2-4629-ae7c-7dec9cc26a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:19.532707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4445451-2fa2-4629-ae7c-7dec9cc26a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:19.533435 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4445451-2fa2-4629-ae7c-7dec9cc26a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:20:19.533745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4445451-2fa2-4629-ae7c-7dec9cc26a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:19.535363 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4445451-2fa2-4629-ae7c-7dec9cc26a3d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:19.544593 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:19.547788 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1389/2779] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:20:19.552248 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd7a3b-1c61-4d8f-9a7d-94065bc2e306 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:19.561753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd7a3b-1c61-4d8f-9a7d-94065bc2e306 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:19.566380 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1012621-7b8d-41bf-90f0-65601d0f5707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:19.567200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1012621-7b8d-41bf-90f0-65601d0f5707 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:19.567331 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1012621-7b8d-41bf-90f0-65601d0f5707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:19.567552 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1012621-7b8d-41bf-90f0-65601d0f5707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:19.568282 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1012621-7b8d-41bf-90f0-65601d0f5707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:19.570170 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1012621-7b8d-41bf-90f0-65601d0f5707 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:19.685753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1391/2780] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:20:19 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:19.689866 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4445451-2fa2-4629-ae7c-7dec9cc26a3d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:19.699700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4445451-2fa2-4629-ae7c-7dec9cc26a3d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:19.757939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288277ac-b2fa-4abe-8087-c1385737031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:19.758769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288277ac-b2fa-4abe-8087-c1385737031a admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:19.759205 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288277ac-b2fa-4abe-8087-c1385737031a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:19.759494 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288277ac-b2fa-4abe-8087-c1385737031a admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:19.760296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288277ac-b2fa-4abe-8087-c1385737031a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:19.762215 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288277ac-b2fa-4abe-8087-c1385737031a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:19.849555 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1390/2781] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:20:19 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:19.854413 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1012621-7b8d-41bf-90f0-65601d0f5707 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:19.865397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1012621-7b8d-41bf-90f0-65601d0f5707 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:19.870295 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ae5e6-c02c-4bd1-bab1-a014ce7dcba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:19.870960 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae5e6-c02c-4bd1-bab1-a014ce7dcba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:19.871250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae5e6-c02c-4bd1-bab1-a014ce7dcba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:19.871565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ae5e6-c02c-4bd1-bab1-a014ce7dcba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:19.872350 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ae5e6-c02c-4bd1-bab1-a014ce7dcba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:19.873986 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ae5e6-c02c-4bd1-bab1-a014ce7dcba5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:19.885777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1392/2782] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:19.889699 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288277ac-b2fa-4abe-8087-c1385737031a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:19.900364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288277ac-b2fa-4abe-8087-c1385737031a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:19.904939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd86db3-20c3-4c0d-ac9a-a650a5f6bc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:19.905578 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86db3-20c3-4c0d-ac9a-a650a5f6bc01 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:19.905860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86db3-20c3-4c0d-ac9a-a650a5f6bc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:19.906136 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86db3-20c3-4c0d-ac9a-a650a5f6bc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:19.906853 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd86db3-20c3-4c0d-ac9a-a650a5f6bc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:19.908469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd86db3-20c3-4c0d-ac9a-a650a5f6bc01 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:19.919096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1391/2783] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:19.923187 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ae5e6-c02c-4bd1-bab1-a014ce7dcba5 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:19.933124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ae5e6-c02c-4bd1-bab1-a014ce7dcba5 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:19.937866 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bad5d-a0e7-4a9b-8731-5f7b8b854584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:19.938681 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bad5d-a0e7-4a9b-8731-5f7b8b854584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:19.938965 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bad5d-a0e7-4a9b-8731-5f7b8b854584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:19.939245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bad5d-a0e7-4a9b-8731-5f7b8b854584 admin admin] PATH_INFO: `/v3/projects/da3a84000d4d40eb9b27644011eddaa9/users/53de3bf5ee324f029965d1e0f6206877/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:19.955075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bad5d-a0e7-4a9b-8731-5f7b8b854584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3a84000d4d40eb9b27644011eddaa9, user_id=53de3bf5ee324f029965d1e0f6206877, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:19.957753 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bad5d-a0e7-4a9b-8731-5f7b8b854584 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:20.038049 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1393/2784] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:19 2022] PUT /identity/v3/projects/da3a84000d4d40eb9b27644011eddaa9/users/53de3bf5ee324f029965d1e0f6206877/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:20.043093 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0986-70cd-4a2a-bb63-6ff723ab9fde None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:20.044453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0986-70cd-4a2a-bb63-6ff723ab9fde None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:20.044453 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c0986-70cd-4a2a-bb63-6ff723ab9fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:20.061219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-516c0986-70cd-4a2a-bb63-6ff723ab9fde None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:20.062414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-516c0986-70cd-4a2a-bb63-6ff723ab9fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:20.122481 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1392/2785] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:20.132127 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bad5d-a0e7-4a9b-8731-5f7b8b854584 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:20.134451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-da2bad5d-a0e7-4a9b-8731-5f7b8b854584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:20.193136 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bad5d-a0e7-4a9b-8731-5f7b8b854584 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:20.198649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac441aa-bab9-452e-b2fe-975ced2eeba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:20.199984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac441aa-bab9-452e-b2fe-975ced2eeba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:20.200270 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac441aa-bab9-452e-b2fe-975ced2eeba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:20.200549 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac441aa-bab9-452e-b2fe-975ced2eeba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:20.209941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac441aa-bab9-452e-b2fe-975ced2eeba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:20.211397 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac441aa-bab9-452e-b2fe-975ced2eeba6 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:20.221318 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1394/2786] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:21.423324 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c3e7e-5ee0-429f-ab24-b9f20ccc6a2f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:21.429668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c3e7e-5ee0-429f-ab24-b9f20ccc6a2f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:21.429668 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c3e7e-5ee0-429f-ab24-b9f20ccc6a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:21.452130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-666c3e7e-5ee0-429f-ab24-b9f20ccc6a2f None None] MFA Rules not processed for user `53de3bf5ee324f029965d1e0f6206877`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:21.453407 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-666c3e7e-5ee0-429f-ab24-b9f20ccc6a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:21.527180 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1393/2787] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:21.531445 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac441aa-bab9-452e-b2fe-975ced2eeba6 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:21.541313 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac441aa-bab9-452e-b2fe-975ced2eeba6 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:21.549711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2771c1b-6f83-4776-8324-6084b068bc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:21.552943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2771c1b-6f83-4776-8324-6084b068bc95 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:21.552943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2771c1b-6f83-4776-8324-6084b068bc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:21.552943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2771c1b-6f83-4776-8324-6084b068bc95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:21.552943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2771c1b-6f83-4776-8324-6084b068bc95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:21.553711 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2771c1b-6f83-4776-8324-6084b068bc95 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:21.616642 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1395/2788] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:20:21 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:20:21.621209 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c3e7e-5ee0-429f-ab24-b9f20ccc6a2f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:21.631971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c3e7e-5ee0-429f-ab24-b9f20ccc6a2f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:21.637224 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:21.691421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb7a31-0973-4d3d-a88c-718d3769aea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:21.692188 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb7a31-0973-4d3d-a88c-718d3769aea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:21.692474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb7a31-0973-4d3d-a88c-718d3769aea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:21.692759 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb7a31-0973-4d3d-a88c-718d3769aea6 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:21.693458 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb7a31-0973-4d3d-a88c-718d3769aea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:21.695398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb7a31-0973-4d3d-a88c-718d3769aea6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:21.793134 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1394/2789] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:20:21 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:20:21.797245 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2771c1b-6f83-4776-8324-6084b068bc95 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:21.807833 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2771c1b-6f83-4776-8324-6084b068bc95 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:21.814620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66ebe0-3189-46a7-880c-a36414a6d2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:21.814620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66ebe0-3189-46a7-880c-a36414a6d2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:21.814620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66ebe0-3189-46a7-880c-a36414a6d2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:21.814620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66ebe0-3189-46a7-880c-a36414a6d2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:21.815120 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66ebe0-3189-46a7-880c-a36414a6d2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:21.816050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66ebe0-3189-46a7-880c-a36414a6d2e9 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:21.827740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1396/2790] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:21.832056 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb7a31-0973-4d3d-a88c-718d3769aea6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:21.842999 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb7a31-0973-4d3d-a88c-718d3769aea6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:21.847785 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9035f0-a5b6-480a-9d07-6127c2aad44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:21.848721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9035f0-a5b6-480a-9d07-6127c2aad44b admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:21.850210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9035f0-a5b6-480a-9d07-6127c2aad44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:21.850210 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9035f0-a5b6-480a-9d07-6127c2aad44b admin admin] PATH_INFO: `/v3/projects/646f9bca905a480f843202074a3b2f54/users/5f6b04203a7d43d2a47004a69ad5d115/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:21.864842 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9035f0-a5b6-480a-9d07-6127c2aad44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=646f9bca905a480f843202074a3b2f54, user_id=5f6b04203a7d43d2a47004a69ad5d115, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:21.868912 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9035f0-a5b6-480a-9d07-6127c2aad44b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:21.930146 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1395/2791] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:21 2022] PUT /identity/v3/projects/646f9bca905a480f843202074a3b2f54/users/5f6b04203a7d43d2a47004a69ad5d115/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:21.935013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66ebe0-3189-46a7-880c-a36414a6d2e9 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:21.947444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66ebe0-3189-46a7-880c-a36414a6d2e9 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:22.009312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b721f40-70dc-4775-9dd9-2bab61c62242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:22.009995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721f40-70dc-4775-9dd9-2bab61c62242 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:22.010284 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721f40-70dc-4775-9dd9-2bab61c62242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:22.010568 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b721f40-70dc-4775-9dd9-2bab61c62242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:22.011300 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b721f40-70dc-4775-9dd9-2bab61c62242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:22.013046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b721f40-70dc-4775-9dd9-2bab61c62242 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:22.014333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:22.025145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1397/2792] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:22.028586 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9035f0-a5b6-480a-9d07-6127c2aad44b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:22.039156 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9035f0-a5b6-480a-9d07-6127c2aad44b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:22.044666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4f09a-cdba-4af6-b96a-e799a46ef0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:22.045484 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f09a-cdba-4af6-b96a-e799a46ef0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:22.045771 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f09a-cdba-4af6-b96a-e799a46ef0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:22.046049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f09a-cdba-4af6-b96a-e799a46ef0a4 admin admin] PATH_INFO: `/v3/projects/646f9bca905a480f843202074a3b2f54/users/5f6b04203a7d43d2a47004a69ad5d115/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:22.048085 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4f09a-cdba-4af6-b96a-e799a46ef0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646f9bca905a480f843202074a3b2f54, user_id=5f6b04203a7d43d2a47004a69ad5d115, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:22.050693 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4f09a-cdba-4af6-b96a-e799a46ef0a4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:22.062009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1396/2793] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:22 2022] PUT /identity/v3/projects/646f9bca905a480f843202074a3b2f54/users/5f6b04203a7d43d2a47004a69ad5d115/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:23.319566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9baf6c-a47f-432d-9e86-8547ddcf0556 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:23.320133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9baf6c-a47f-432d-9e86-8547ddcf0556 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:23.320133 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9baf6c-a47f-432d-9e86-8547ddcf0556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:23.353171 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-fa9baf6c-a47f-432d-9e86-8547ddcf0556 None None] MFA Rules not processed for user `5f6b04203a7d43d2a47004a69ad5d115`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:23.353953 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-fa9baf6c-a47f-432d-9e86-8547ddcf0556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:23.430827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1398/2794] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:23.441848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365b3e8-dbbd-471b-9b3d-5b5ae92d2876 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:23.442380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365b3e8-dbbd-471b-9b3d-5b5ae92d2876 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:23.442380 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365b3e8-dbbd-471b-9b3d-5b5ae92d2876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:23.460145 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2365b3e8-dbbd-471b-9b3d-5b5ae92d2876 None None] MFA Rules not processed for user `53de3bf5ee324f029965d1e0f6206877`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:23.461875 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2365b3e8-dbbd-471b-9b3d-5b5ae92d2876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:23.518575 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1397/2795] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:23.532296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9baf6c-a47f-432d-9e86-8547ddcf0556 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:23.533719 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-fa9baf6c-a47f-432d-9e86-8547ddcf0556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:23.609905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9baf6c-a47f-432d-9e86-8547ddcf0556 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:23.615444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72231aa-5894-477d-9bde-4dacbccf5600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:23.616125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72231aa-5894-477d-9bde-4dacbccf5600 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:23.616418 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72231aa-5894-477d-9bde-4dacbccf5600 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:23.616699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72231aa-5894-477d-9bde-4dacbccf5600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:23.625202 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72231aa-5894-477d-9bde-4dacbccf5600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:23.629507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72231aa-5894-477d-9bde-4dacbccf5600 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:23.636352 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1399/2796] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:23.861399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365b3e8-dbbd-471b-9b3d-5b5ae92d2876 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:23.918769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365b3e8-dbbd-471b-9b3d-5b5ae92d2876 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:23.922433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f37f3f-b7c3-4eaa-ae7a-6be43ac9fc32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:23.923025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f37f3f-b7c3-4eaa-ae7a-6be43ac9fc32 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:23.928703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f37f3f-b7c3-4eaa-ae7a-6be43ac9fc32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:23.928703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f37f3f-b7c3-4eaa-ae7a-6be43ac9fc32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:23.928703 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-98f37f3f-b7c3-4eaa-ae7a-6be43ac9fc32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:23.935628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f37f3f-b7c3-4eaa-ae7a-6be43ac9fc32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:23.937231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f37f3f-b7c3-4eaa-ae7a-6be43ac9fc32 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:23.946227 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1398/2797] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:29.105417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72231aa-5894-477d-9bde-4dacbccf5600 service nova] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:29.106898 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d72231aa-5894-477d-9bde-4dacbccf5600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:29.174461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72231aa-5894-477d-9bde-4dacbccf5600 service nova] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:29.179076 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:29.180016 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:29.180873 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:29.181168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] PATH_INFO: `/v3/users/984db53b0c954eb586702d244a46662d` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:29.182494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984db53b0c954eb586702d244a46662d)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:29.184480 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:29.190075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:29.388767 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984db53b0c954eb586702d244a46662d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:29.401277 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984db53b0c954eb586702d244a46662d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:29.401937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984db53b0c954eb586702d244a46662d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:29.408684 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984db53b0c954eb586702d244a46662d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:29.413521 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984db53b0c954eb586702d244a46662d'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:29.489141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1400/2798] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:29 2022] DELETE /identity/v3/users/984db53b0c954eb586702d244a46662d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:29.493669 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628c7b8-4a2e-46e3-838c-22928c884af5 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:29.494144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628c7b8-4a2e-46e3-838c-22928c884af5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:29.494283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628c7b8-4a2e-46e3-838c-22928c884af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:29.511815 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7628c7b8-4a2e-46e3-838c-22928c884af5 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:29.513049 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7628c7b8-4a2e-46e3-838c-22928c884af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:29.517119 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:29.573082 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1399/2799] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:29.582769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:29.584206 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:29.641892 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21de6a-47d7-4f60-97f7-d2e18f9b8729 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:29.645727 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dcae3-7e05-42d0-8084-d2e0f2887b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:29.646377 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dcae3-7e05-42d0-8084-d2e0f2887b99 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:29.648451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dcae3-7e05-42d0-8084-d2e0f2887b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:29.648451 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dcae3-7e05-42d0-8084-d2e0f2887b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:29.656756 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dcae3-7e05-42d0-8084-d2e0f2887b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:29.658201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dcae3-7e05-42d0-8084-d2e0f2887b99 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:29.668540 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1401/2800] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:30.080055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628c7b8-4a2e-46e3-838c-22928c884af5 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:30.081583 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7628c7b8-4a2e-46e3-838c-22928c884af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:30.095007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628c7b8-4a2e-46e3-838c-22928c884af5 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:30.106513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:30.106513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.106513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.106513 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] PATH_INFO: `/v3/projects/8b7ec24e5f5a4a20bb08939c1686afec` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.106878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7ec24e5f5a4a20bb08939c1686afec)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:30.106878 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:30.274399 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7ec24e5f5a4a20bb08939c1686afec', 'request_id': 'req-8570fb77-277b-43f1-9b5f-2762f1df53ed'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.280220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7ec24e5f5a4a20bb08939c1686afec', 'request_id': 'req-8570fb77-277b-43f1-9b5f-2762f1df53ed'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.286844 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7ec24e5f5a4a20bb08939c1686afec', 'request_id': 'req-8570fb77-277b-43f1-9b5f-2762f1df53ed'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.352232 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] The token cache is being invalidate because project 8b7ec24e5f5a4a20bb08939c1686afec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:30.352655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.353416 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8570fb77-277b-43f1-9b5f-2762f1df53ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:30.354943 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1400/2801] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:30 2022] DELETE /identity/v3/projects/8b7ec24e5f5a4a20bb08939c1686afec => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:30.360426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832a48-2e42-4e78-b7b9-9feae0e00492 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.360909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832a48-2e42-4e78-b7b9-9feae0e00492 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.361112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832a48-2e42-4e78-b7b9-9feae0e00492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.379390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-45832a48-2e42-4e78-b7b9-9feae0e00492 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:30.380667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-45832a48-2e42-4e78-b7b9-9feae0e00492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:30.441179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1402/2802] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:30.449737 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275804-9c02-461f-aa22-90c7b15592a0 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.449974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275804-9c02-461f-aa22-90c7b15592a0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.450257 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c275804-9c02-461f-aa22-90c7b15592a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.469372 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2c275804-9c02-461f-aa22-90c7b15592a0 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:30.470583 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2c275804-9c02-461f-aa22-90c7b15592a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:30.479183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1401/2803] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:30.483200 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45832a48-2e42-4e78-b7b9-9feae0e00492 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:30.492708 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45832a48-2e42-4e78-b7b9-9feae0e00492 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:30.498825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f446ea2-e2ef-4e29-8927-69364b7c5c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:30.499479 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f446ea2-e2ef-4e29-8927-69364b7c5c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.499805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f446ea2-e2ef-4e29-8927-69364b7c5c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.500089 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f446ea2-e2ef-4e29-8927-69364b7c5c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.500813 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f446ea2-e2ef-4e29-8927-69364b7c5c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:20:30.501129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f446ea2-e2ef-4e29-8927-69364b7c5c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:30.502742 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f446ea2-e2ef-4e29-8927-69364b7c5c6f admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:30.515166 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1403/2804] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:20:30.519664 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275804-9c02-461f-aa22-90c7b15592a0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:30.529052 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c275804-9c02-461f-aa22-90c7b15592a0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:30.533769 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daa470-3f62-4703-af59-5dbe5f40379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:30.534421 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daa470-3f62-4703-af59-5dbe5f40379c admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.534706 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daa470-3f62-4703-af59-5dbe5f40379c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.534987 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1daa470-3f62-4703-af59-5dbe5f40379c admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.535721 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1daa470-3f62-4703-af59-5dbe5f40379c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:30.537687 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1daa470-3f62-4703-af59-5dbe5f40379c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:30.610413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1402/2805] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:20:30 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:20:30.614559 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f446ea2-e2ef-4e29-8927-69364b7c5c6f admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:30.624998 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f446ea2-e2ef-4e29-8927-69364b7c5c6f admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:30.636523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:30.681582 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95cc5d-ba25-4a4e-b54d-0217742b6746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:30.682265 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95cc5d-ba25-4a4e-b54d-0217742b6746 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.682702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95cc5d-ba25-4a4e-b54d-0217742b6746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.683218 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95cc5d-ba25-4a4e-b54d-0217742b6746 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.684214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95cc5d-ba25-4a4e-b54d-0217742b6746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:30.686664 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95cc5d-ba25-4a4e-b54d-0217742b6746 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:30.746672 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1404/2806] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:20:30 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:30.750793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daa470-3f62-4703-af59-5dbe5f40379c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:30.761645 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1daa470-3f62-4703-af59-5dbe5f40379c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:30.766275 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a2b5d-ffb5-4b87-a2f8-318d82f50e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:30.766928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a2b5d-ffb5-4b87-a2f8-318d82f50e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.767216 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a2b5d-ffb5-4b87-a2f8-318d82f50e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.767500 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a2b5d-ffb5-4b87-a2f8-318d82f50e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.768263 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a2b5d-ffb5-4b87-a2f8-318d82f50e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:30.770256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a2b5d-ffb5-4b87-a2f8-318d82f50e81 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:30.781040 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1403/2807] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:30.784964 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95cc5d-ba25-4a4e-b54d-0217742b6746 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:30.795831 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95cc5d-ba25-4a4e-b54d-0217742b6746 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:30.800444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aef78-27d9-44b5-8522-6e70fcd08c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:30.801087 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aef78-27d9-44b5-8522-6e70fcd08c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.801372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aef78-27d9-44b5-8522-6e70fcd08c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.801649 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aef78-27d9-44b5-8522-6e70fcd08c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.802404 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aef78-27d9-44b5-8522-6e70fcd08c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:30.804017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aef78-27d9-44b5-8522-6e70fcd08c2d admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:30.814346 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1405/2808] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:20:30.818258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a2b5d-ffb5-4b87-a2f8-318d82f50e81 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:30.828433 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a2b5d-ffb5-4b87-a2f8-318d82f50e81 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:30.833169 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c16491-410a-4017-95ce-72b4b7a8a001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:30.834030 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c16491-410a-4017-95ce-72b4b7a8a001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.834315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c16491-410a-4017-95ce-72b4b7a8a001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.834618 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c16491-410a-4017-95ce-72b4b7a8a001 admin admin] PATH_INFO: `/v3/projects/be15fb7fef844d16b6ee516436b84219/users/036aa88a69544be8a05944ef9c7492f1/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:30.849228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c16491-410a-4017-95ce-72b4b7a8a001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be15fb7fef844d16b6ee516436b84219, user_id=036aa88a69544be8a05944ef9c7492f1, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:30.851894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c16491-410a-4017-95ce-72b4b7a8a001 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:30.895802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1404/2809] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:30 2022] PUT /identity/v3/projects/be15fb7fef844d16b6ee516436b84219/users/036aa88a69544be8a05944ef9c7492f1/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:30.961006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519f37c-df54-481e-9c19-2a568ce4110c None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:30.962116 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519f37c-df54-481e-9c19-2a568ce4110c None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:30.962530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519f37c-df54-481e-9c19-2a568ce4110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:31.004556 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-c519f37c-df54-481e-9c19-2a568ce4110c None None] MFA Rules not processed for user `036aa88a69544be8a05944ef9c7492f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:31.005744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c519f37c-df54-481e-9c19-2a568ce4110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:31.074359 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1406/2810] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:31.090891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c16491-410a-4017-95ce-72b4b7a8a001 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:31.090891 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-87c16491-410a-4017-95ce-72b4b7a8a001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:31.122201 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:31.146729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c16491-410a-4017-95ce-72b4b7a8a001 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:31.150928 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d38be-d188-4cc3-8df5-ec2114465c88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:31.151754 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d38be-d188-4cc3-8df5-ec2114465c88 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:31.152036 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d38be-d188-4cc3-8df5-ec2114465c88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:31.152308 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d38be-d188-4cc3-8df5-ec2114465c88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:31.160447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d38be-d188-4cc3-8df5-ec2114465c88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:31.161861 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68d38be-d188-4cc3-8df5-ec2114465c88 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:31.171894 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1405/2811] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:35.070390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519f37c-df54-481e-9c19-2a568ce4110c None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:35.135574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519f37c-df54-481e-9c19-2a568ce4110c None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:35.140402 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:35.141302 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:35.141769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:35.142250 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] PATH_INFO: `/v3/users/036aa88a69544be8a05944ef9c7492f1` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:35.144609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036aa88a69544be8a05944ef9c7492f1)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:35.147943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:35.238495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:35.285512 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036aa88a69544be8a05944ef9c7492f1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:35.298734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036aa88a69544be8a05944ef9c7492f1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:35.299409 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036aa88a69544be8a05944ef9c7492f1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:35.306379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036aa88a69544be8a05944ef9c7492f1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:35.307101 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036aa88a69544be8a05944ef9c7492f1'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:35.357919 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1407/2812] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:35 2022] DELETE /identity/v3/users/036aa88a69544be8a05944ef9c7492f1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:35.362415 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf25e34-a359-42ff-a71b-28fc9fd93f62 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:35.362939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf25e34-a359-42ff-a71b-28fc9fd93f62 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:35.362939 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf25e34-a359-42ff-a71b-28fc9fd93f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:35.379915 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0cf25e34-a359-42ff-a71b-28fc9fd93f62 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:35.381142 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0cf25e34-a359-42ff-a71b-28fc9fd93f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:35.440510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1406/2813] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:35.450107 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:35.451537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:35.507908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f48a-83d7-4904-8c1d-8ed8f0f3ddd8 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:35.511560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ab4c0-e377-4c09-8e54-b633edac9e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:35.512235 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ab4c0-e377-4c09-8e54-b633edac9e38 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:35.512525 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ab4c0-e377-4c09-8e54-b633edac9e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:35.512937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ab4c0-e377-4c09-8e54-b633edac9e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:35.522577 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ab4c0-e377-4c09-8e54-b633edac9e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:35.524056 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ab4c0-e377-4c09-8e54-b633edac9e38 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:35.534086 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1408/2814] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:35.924786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf25e34-a359-42ff-a71b-28fc9fd93f62 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:35.926447 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0cf25e34-a359-42ff-a71b-28fc9fd93f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:35.938525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf25e34-a359-42ff-a71b-28fc9fd93f62 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:35.943834 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:35.944873 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:35.945162 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:35.945440 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] PATH_INFO: `/v3/projects/be15fb7fef844d16b6ee516436b84219` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:35.946798 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be15fb7fef844d16b6ee516436b84219)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:35.948747 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:36.048615 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be15fb7fef844d16b6ee516436b84219', 'request_id': 'req-84745864-2be6-489d-ae8b-8f15eace3416'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:36.058723 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be15fb7fef844d16b6ee516436b84219', 'request_id': 'req-84745864-2be6-489d-ae8b-8f15eace3416'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:36.068990 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be15fb7fef844d16b6ee516436b84219', 'request_id': 'req-84745864-2be6-489d-ae8b-8f15eace3416'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:36.163020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] The token cache is being invalidate because project be15fb7fef844d16b6ee516436b84219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:36.163315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:36.163973 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-84745864-2be6-489d-ae8b-8f15eace3416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:36.165528 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1407/2815] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:35 2022] DELETE /identity/v3/projects/be15fb7fef844d16b6ee516436b84219 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:36.170583 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693531f1-d59d-4b5d-a562-f3c11cf0dc72 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:36.171090 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693531f1-d59d-4b5d-a562-f3c11cf0dc72 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:36.171192 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693531f1-d59d-4b5d-a562-f3c11cf0dc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:36.189207 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-693531f1-d59d-4b5d-a562-f3c11cf0dc72 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:36.190419 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-693531f1-d59d-4b5d-a562-f3c11cf0dc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:36.254867 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1409/2816] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:20:36.262309 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b8f1-b50d-40ab-8387-c0e35a6a02bf None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:36.262603 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b8f1-b50d-40ab-8387-c0e35a6a02bf None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:36.262886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b8f1-b50d-40ab-8387-c0e35a6a02bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:36.282193 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e554b8f1-b50d-40ab-8387-c0e35a6a02bf None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:36.283423 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e554b8f1-b50d-40ab-8387-c0e35a6a02bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:36.291689 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1408/2817] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:36.296034 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693531f1-d59d-4b5d-a562-f3c11cf0dc72 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:36.305373 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693531f1-d59d-4b5d-a562-f3c11cf0dc72 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:36.310656 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54541312-73dd-4e35-bfe4-8afe32d7c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:36.311399 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541312-73dd-4e35-bfe4-8afe32d7c707 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:36.311713 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541312-73dd-4e35-bfe4-8afe32d7c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:36.311985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54541312-73dd-4e35-bfe4-8afe32d7c707 admin admin] PATH_INFO: `/v3/domains` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:36.312714 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54541312-73dd-4e35-bfe4-8afe32d7c707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80300) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:20:36.313019 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54541312-73dd-4e35-bfe4-8afe32d7c707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:36.314620 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54541312-73dd-4e35-bfe4-8afe32d7c707 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:36.327667 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1410/2818] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:20:36.331907 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554b8f1-b50d-40ab-8387-c0e35a6a02bf None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:36.341228 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554b8f1-b50d-40ab-8387-c0e35a6a02bf None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:36.345984 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968a48e-123b-45f3-9bc5-e8ec3cb9c59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:36.346665 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968a48e-123b-45f3-9bc5-e8ec3cb9c59c admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:36.346950 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968a48e-123b-45f3-9bc5-e8ec3cb9c59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:36.347231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968a48e-123b-45f3-9bc5-e8ec3cb9c59c admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:36.347992 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968a48e-123b-45f3-9bc5-e8ec3cb9c59c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:36.349889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968a48e-123b-45f3-9bc5-e8ec3cb9c59c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:36.486413 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1409/2819] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:20:36 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:20:36.490581 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54541312-73dd-4e35-bfe4-8afe32d7c707 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:36.501050 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54541312-73dd-4e35-bfe4-8afe32d7c707 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:36.533744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:36.564290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e065133-63f3-4c74-b4e4-93b1d9521a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:36.565140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e065133-63f3-4c74-b4e4-93b1d9521a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:36.565430 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e065133-63f3-4c74-b4e4-93b1d9521a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:36.565729 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e065133-63f3-4c74-b4e4-93b1d9521a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:36.566448 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e065133-63f3-4c74-b4e4-93b1d9521a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:36.568507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e065133-63f3-4c74-b4e4-93b1d9521a27 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:36.632197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1411/2820] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:20:36 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:20:36.636517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968a48e-123b-45f3-9bc5-e8ec3cb9c59c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:36.648009 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968a48e-123b-45f3-9bc5-e8ec3cb9c59c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:36.652951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068f437-aa34-467e-99b3-07024f5266bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:36.653704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068f437-aa34-467e-99b3-07024f5266bd admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:36.654055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068f437-aa34-467e-99b3-07024f5266bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:36.654398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068f437-aa34-467e-99b3-07024f5266bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:36.655195 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068f437-aa34-467e-99b3-07024f5266bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:36.656900 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068f437-aa34-467e-99b3-07024f5266bd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:36.667643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1410/2821] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:36.672339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e065133-63f3-4c74-b4e4-93b1d9521a27 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:36.682361 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e065133-63f3-4c74-b4e4-93b1d9521a27 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:36.687788 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7e6bd-a76b-40a0-8f7d-d39c73181142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:36.688996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7e6bd-a76b-40a0-8f7d-d39c73181142 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:36.688996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7e6bd-a76b-40a0-8f7d-d39c73181142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:36.688996 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7e6bd-a76b-40a0-8f7d-d39c73181142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:36.689715 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7e6bd-a76b-40a0-8f7d-d39c73181142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:36.691299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7e6bd-a76b-40a0-8f7d-d39c73181142 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:36.701483 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1412/2822] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:36.705591 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068f437-aa34-467e-99b3-07024f5266bd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:36.715988 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068f437-aa34-467e-99b3-07024f5266bd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:36.720922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd1810-c817-4950-ab7a-5f396d430e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:36.721795 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd1810-c817-4950-ab7a-5f396d430e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:36.722111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd1810-c817-4950-ab7a-5f396d430e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:36.722390 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd1810-c817-4950-ab7a-5f396d430e98 admin admin] PATH_INFO: `/v3/projects/88a5e8e41cc64df49f2e7520763fdf43/users/e978b862a1174162b3b8ead8e090c245/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:36.735347 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:36.738342 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd1810-c817-4950-ab7a-5f396d430e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a5e8e41cc64df49f2e7520763fdf43, user_id=e978b862a1174162b3b8ead8e090c245, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:36.741035 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd1810-c817-4950-ab7a-5f396d430e98 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:36.799448 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1411/2823] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:36 2022] PUT /identity/v3/projects/88a5e8e41cc64df49f2e7520763fdf43/users/e978b862a1174162b3b8ead8e090c245/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:36.811599 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115126a2-6211-4b22-8ee3-d100115cbfd0 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:36.811908 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115126a2-6211-4b22-8ee3-d100115cbfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:36.812197 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115126a2-6211-4b22-8ee3-d100115cbfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:36.840004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-115126a2-6211-4b22-8ee3-d100115cbfd0 None None] MFA Rules not processed for user `e978b862a1174162b3b8ead8e090c245`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:36.842054 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-115126a2-6211-4b22-8ee3-d100115cbfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:36.913356 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1413/2824] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:36.925511 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd1810-c817-4950-ab7a-5f396d430e98 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:36.927282 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-86dd1810-c817-4950-ab7a-5f396d430e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:36.986768 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd1810-c817-4950-ab7a-5f396d430e98 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:36.990410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff57ce-4879-4de6-8517-44136376cb74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:36.991047 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff57ce-4879-4de6-8517-44136376cb74 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:36.991420 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff57ce-4879-4de6-8517-44136376cb74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:36.991678 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff57ce-4879-4de6-8517-44136376cb74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:37.000296 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff57ce-4879-4de6-8517-44136376cb74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:37.001718 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff57ce-4879-4de6-8517-44136376cb74 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:37.010782 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1412/2825] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:38.400613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115126a2-6211-4b22-8ee3-d100115cbfd0 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:38.410654 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115126a2-6211-4b22-8ee3-d100115cbfd0 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:38.414149 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a7593-9ca4-4039-918f-721c8f04c608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:38.414785 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a7593-9ca4-4039-918f-721c8f04c608 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:38.415100 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a7593-9ca4-4039-918f-721c8f04c608 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:38.415383 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a7593-9ca4-4039-918f-721c8f04c608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:38.417170 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f65a7593-9ca4-4039-918f-721c8f04c608 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:38.479256 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a7593-9ca4-4039-918f-721c8f04c608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:38.480851 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a7593-9ca4-4039-918f-721c8f04c608 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:38.490530 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1414/2826] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:39.963104 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff57ce-4879-4de6-8517-44136376cb74 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:40.025196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff57ce-4879-4de6-8517-44136376cb74 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:40.029738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:40.030600 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:40.030886 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:40.031161 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] PATH_INFO: `/v3/users/e978b862a1174162b3b8ead8e090c245` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:40.032376 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e978b862a1174162b3b8ead8e090c245)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:40.034294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:40.199072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e978b862a1174162b3b8ead8e090c245'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:40.278150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e978b862a1174162b3b8ead8e090c245'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:40.290563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e978b862a1174162b3b8ead8e090c245'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:40.291219 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e978b862a1174162b3b8ead8e090c245'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:40.291848 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e978b862a1174162b3b8ead8e090c245'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:40.305461 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1413/2827] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:20:39 2022] DELETE /identity/v3/users/e978b862a1174162b3b8ead8e090c245 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:40.310743 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57cfc8-bd23-452d-90b1-1084aae60feb None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:40.311272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57cfc8-bd23-452d-90b1-1084aae60feb None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:40.311487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57cfc8-bd23-452d-90b1-1084aae60feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:40.329075 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-2d57cfc8-bd23-452d-90b1-1084aae60feb None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:40.330311 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-2d57cfc8-bd23-452d-90b1-1084aae60feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:40.361602 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:40.391741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1415/2828] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:40.401414 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:40.403002 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:40.416887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:40.460220 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c4e9f-0a46-43b0-b840-f4623e02e154 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:40.463842 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701927ef-0a79-4305-b984-f4142bec2eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:40.464479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701927ef-0a79-4305-b984-f4142bec2eee service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:40.464788 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701927ef-0a79-4305-b984-f4142bec2eee service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:40.465101 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701927ef-0a79-4305-b984-f4142bec2eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:40.474739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701927ef-0a79-4305-b984-f4142bec2eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:40.476348 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701927ef-0a79-4305-b984-f4142bec2eee service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:40.486062 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1414/2829] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:40.897143 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57cfc8-bd23-452d-90b1-1084aae60feb None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:40.898598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-2d57cfc8-bd23-452d-90b1-1084aae60feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:40.911134 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57cfc8-bd23-452d-90b1-1084aae60feb None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:40.915861 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:40.916657 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:40.916938 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:40.917214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] PATH_INFO: `/v3/projects/88a5e8e41cc64df49f2e7520763fdf43` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:40.918471 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a5e8e41cc64df49f2e7520763fdf43)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:40.920465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:41.022310 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a5e8e41cc64df49f2e7520763fdf43', 'request_id': 'req-7e065882-978c-4561-a953-9b91ffae2bd5'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:41.083770 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a5e8e41cc64df49f2e7520763fdf43', 'request_id': 'req-7e065882-978c-4561-a953-9b91ffae2bd5'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:41.090633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a5e8e41cc64df49f2e7520763fdf43', 'request_id': 'req-7e065882-978c-4561-a953-9b91ffae2bd5'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:41.101396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] The token cache is being invalidate because project 88a5e8e41cc64df49f2e7520763fdf43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:20:41.101733 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:41.102432 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-7e065882-978c-4561-a953-9b91ffae2bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:20:41.104046 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1416/2830] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:20:40 2022] DELETE /identity/v3/projects/88a5e8e41cc64df49f2e7520763fdf43 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:20:41.109833 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5878c7-b17f-441f-acec-a785f2809b16 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:41.110326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5878c7-b17f-441f-acec-a785f2809b16 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:41.110443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5878c7-b17f-441f-acec-a785f2809b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:41.128683 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bc5878c7-b17f-441f-acec-a785f2809b16 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:41.129881 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bc5878c7-b17f-441f-acec-a785f2809b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:41.189019 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1415/2831] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:41.196579 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4796-04fd-4472-9124-0ace24659fc2 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:41.196916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4796-04fd-4472-9124-0ace24659fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:41.197241 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d4796-04fd-4472-9124-0ace24659fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:41.217762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-4d5d4796-04fd-4472-9124-0ace24659fc2 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:41.218990 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4d5d4796-04fd-4472-9124-0ace24659fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:41.227272 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1417/2832] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:41.232457 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5878c7-b17f-441f-acec-a785f2809b16 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:41.242182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5878c7-b17f-441f-acec-a785f2809b16 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:41.247653 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee97123-2462-4281-8ff4-e44b01153d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:41.248314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee97123-2462-4281-8ff4-e44b01153d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:41.248604 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee97123-2462-4281-8ff4-e44b01153d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:41.248889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee97123-2462-4281-8ff4-e44b01153d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:41.249625 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee97123-2462-4281-8ff4-e44b01153d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:20:41.249936 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee97123-2462-4281-8ff4-e44b01153d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:41.251538 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee97123-2462-4281-8ff4-e44b01153d89 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:41.264799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1416/2833] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:20:41.271129 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d4796-04fd-4472-9124-0ace24659fc2 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:41.281646 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d4796-04fd-4472-9124-0ace24659fc2 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:41.286994 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeff975-6f6a-4b22-bb86-919307d8f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:41.287697 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff975-6f6a-4b22-bb86-919307d8f099 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:41.287982 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff975-6f6a-4b22-bb86-919307d8f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:41.288260 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeff975-6f6a-4b22-bb86-919307d8f099 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:41.290035 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeff975-6f6a-4b22-bb86-919307d8f099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:41.290854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeff975-6f6a-4b22-bb86-919307d8f099 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:41.365354 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1418/2834] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:20:41 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:20:41.369490 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee97123-2462-4281-8ff4-e44b01153d89 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:41.381055 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee97123-2462-4281-8ff4-e44b01153d89 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:41.450732 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2e5de-4167-4e40-a2dc-633f180f0fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:41.451410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2e5de-4167-4e40-a2dc-633f180f0fca admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:41.451734 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2e5de-4167-4e40-a2dc-633f180f0fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:41.452015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2e5de-4167-4e40-a2dc-633f180f0fca admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:41.452744 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2e5de-4167-4e40-a2dc-633f180f0fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:41.454654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2e5de-4167-4e40-a2dc-633f180f0fca admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:41.564216 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1417/2835] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:20:41 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:20:41.568490 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeff975-6f6a-4b22-bb86-919307d8f099 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:41.578988 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeff975-6f6a-4b22-bb86-919307d8f099 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:41.583461 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4739ea-bec7-41da-a485-b95d92a873ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:41.584148 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4739ea-bec7-41da-a485-b95d92a873ce admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:41.584437 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4739ea-bec7-41da-a485-b95d92a873ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:41.584984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4739ea-bec7-41da-a485-b95d92a873ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:41.585504 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4739ea-bec7-41da-a485-b95d92a873ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:41.587117 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4739ea-bec7-41da-a485-b95d92a873ce admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:41.598483 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1419/2836] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:41.602572 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2e5de-4167-4e40-a2dc-633f180f0fca admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:41.613974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2e5de-4167-4e40-a2dc-633f180f0fca admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:41.618658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a9099-9825-4b6e-b4c8-388d1ff19eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:41.619364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9099-9825-4b6e-b4c8-388d1ff19eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:41.619696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9099-9825-4b6e-b4c8-388d1ff19eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:41.619985 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a9099-9825-4b6e-b4c8-388d1ff19eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:41.620850 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a9099-9825-4b6e-b4c8-388d1ff19eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:41.622868 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a9099-9825-4b6e-b4c8-388d1ff19eb8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:41.635285 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1418/2837] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:20:41.640148 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4739ea-bec7-41da-a485-b95d92a873ce admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:41.650865 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4739ea-bec7-41da-a485-b95d92a873ce admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:41.656486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef94d64-2eef-4f20-b2dd-68243b7a3a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:41.657350 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef94d64-2eef-4f20-b2dd-68243b7a3a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:41.657639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef94d64-2eef-4f20-b2dd-68243b7a3a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:41.657918 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef94d64-2eef-4f20-b2dd-68243b7a3a25 admin admin] PATH_INFO: `/v3/projects/6f9a44959c764a16bf51132ab57bba52/users/b82496c07cbc4319825c162fad2ef077/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:41.673473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef94d64-2eef-4f20-b2dd-68243b7a3a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9a44959c764a16bf51132ab57bba52, user_id=b82496c07cbc4319825c162fad2ef077, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:41.676225 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef94d64-2eef-4f20-b2dd-68243b7a3a25 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:41.747063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1420/2838] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:20:41 2022] PUT /identity/v3/projects/6f9a44959c764a16bf51132ab57bba52/users/b82496c07cbc4319825c162fad2ef077/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:20:41.757208 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ff40d-f7b2-419c-b556-feb9584c2d29 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:41.762560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ff40d-f7b2-419c-b556-feb9584c2d29 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:41.762560 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ff40d-f7b2-419c-b556-feb9584c2d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:41.784993 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1d8ff40d-f7b2-419c-b556-feb9584c2d29 None None] MFA Rules not processed for user `b82496c07cbc4319825c162fad2ef077`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:41.786182 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1d8ff40d-f7b2-419c-b556-feb9584c2d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:41.795471 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:41.851640 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1419/2839] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:41.862846 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef94d64-2eef-4f20-b2dd-68243b7a3a25 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:41.864706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-aef94d64-2eef-4f20-b2dd-68243b7a3a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:41.922470 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef94d64-2eef-4f20-b2dd-68243b7a3a25 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:41.926199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada75d99-b351-4df5-bce8-c67f8b9ad566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:41.926814 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75d99-b351-4df5-bce8-c67f8b9ad566 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:41.927103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75d99-b351-4df5-bce8-c67f8b9ad566 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:41.927379 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada75d99-b351-4df5-bce8-c67f8b9ad566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:41.936554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada75d99-b351-4df5-bce8-c67f8b9ad566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:41.938004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada75d99-b351-4df5-bce8-c67f8b9ad566 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:41.941677 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:41.954445 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1421/2840] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:20:43.668301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed549b7-fcd4-493d-887c-0412680c864d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:43.669060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed549b7-fcd4-493d-887c-0412680c864d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:43.669060 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed549b7-fcd4-493d-887c-0412680c864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:43.687157 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-aed549b7-fcd4-493d-887c-0412680c864d None None] MFA Rules not processed for user `b82496c07cbc4319825c162fad2ef077`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:20:43.688479 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-aed549b7-fcd4-493d-887c-0412680c864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:43.695554 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1420/2841] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:20:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:20:52.021885 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:53.681489 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=25 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:20:58.961523 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada75d99-b351-4df5-bce8-c67f8b9ad566 service cinder] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:20:58.963069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ada75d99-b351-4df5-bce8-c67f8b9ad566 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:59.043426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada75d99-b351-4df5-bce8-c67f8b9ad566 service cinder] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:20:59.048658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a212e2d-c8a8-4bc9-b6ab-efcb88ac1a38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdf5c7049f8499b8a25c88fbf4cb795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:20:59.049305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a212e2d-c8a8-4bc9-b6ab-efcb88ac1a38 service placement] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:20:59.051607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a212e2d-c8a8-4bc9-b6ab-efcb88ac1a38 service placement] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:20:59.051607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a212e2d-c8a8-4bc9-b6ab-efcb88ac1a38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:20:59.051607 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8a212e2d-c8a8-4bc9-b6ab-efcb88ac1a38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:20:59.063103 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a212e2d-c8a8-4bc9-b6ab-efcb88ac1a38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:20:59.064737 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a212e2d-c8a8-4bc9-b6ab-efcb88ac1a38 service placement] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:20:59.074644 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1422/2842] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:20:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:21:00.039824 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09961671-8233-42f9-9fb2-64cf9eddd994 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:00.040288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09961671-8233-42f9-9fb2-64cf9eddd994 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:00.040417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09961671-8233-42f9-9fb2-64cf9eddd994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:00.058652 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-09961671-8233-42f9-9fb2-64cf9eddd994 None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:00.059896 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-09961671-8233-42f9-9fb2-64cf9eddd994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:00.113408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1421/2843] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:21:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:00.237529 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a212e2d-c8a8-4bc9-b6ab-efcb88ac1a38 service placement] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:00.239006 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-8a212e2d-c8a8-4bc9-b6ab-efcb88ac1a38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:00.308648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a212e2d-c8a8-4bc9-b6ab-efcb88ac1a38 service placement] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:00.313948 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faee72-bb46-4498-bc13-d0c89e60acc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:00.314589 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faee72-bb46-4498-bc13-d0c89e60acc2 service swift] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:00.314874 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faee72-bb46-4498-bc13-d0c89e60acc2 service swift] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:00.315149 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43faee72-bb46-4498-bc13-d0c89e60acc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:00.326539 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43faee72-bb46-4498-bc13-d0c89e60acc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:00.328495 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43faee72-bb46-4498-bc13-d0c89e60acc2 service swift] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:00.337125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1423/2844] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:21:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:21:01.179179 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72469d-cbcc-4d6a-ac5c-d19ee342cd0d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:01.179738 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72469d-cbcc-4d6a-ac5c-d19ee342cd0d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:01.179842 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72469d-cbcc-4d6a-ac5c-d19ee342cd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:01.199735 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-dd72469d-cbcc-4d6a-ac5c-d19ee342cd0d None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:01.201326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-dd72469d-cbcc-4d6a-ac5c-d19ee342cd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:01.208802 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1422/2845] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 2 10:21:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:01.221287 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faee72-bb46-4498-bc13-d0c89e60acc2 service swift] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:01.232463 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43faee72-bb46-4498-bc13-d0c89e60acc2 service swift] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:01.237640 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc26080-3af4-410e-bcb4-52d522db3e2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:01.240069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc26080-3af4-410e-bcb4-52d522db3e2c service swift] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:01.240069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc26080-3af4-410e-bcb4-52d522db3e2c service swift] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:01.240069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc26080-3af4-410e-bcb4-52d522db3e2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:01.248140 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc26080-3af4-410e-bcb4-52d522db3e2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:01.249805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc26080-3af4-410e-bcb4-52d522db3e2c service swift] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:01.258155 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1424/2846] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:21:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:21:01.563715 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72469d-cbcc-4d6a-ac5c-d19ee342cd0d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:01.567825 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-dd72469d-cbcc-4d6a-ac5c-d19ee342cd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:01.633283 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72469d-cbcc-4d6a-ac5c-d19ee342cd0d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:01.638057 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:01.640226 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:01.640517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:01.640803 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] PATH_INFO: `/v3/users/53de3bf5ee324f029965d1e0f6206877` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:01.642139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53de3bf5ee324f029965d1e0f6206877)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:01.644316 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:01.835485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53de3bf5ee324f029965d1e0f6206877'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:01.889322 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53de3bf5ee324f029965d1e0f6206877'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:01.894717 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54d63-1293-4edb-ad90-59dfc860a47a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:01.896436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54d63-1293-4edb-ad90-59dfc860a47a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:01.896436 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54d63-1293-4edb-ad90-59dfc860a47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:01.902874 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53de3bf5ee324f029965d1e0f6206877'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:01.903557 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53de3bf5ee324f029965d1e0f6206877'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:01.904887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53de3bf5ee324f029965d1e0f6206877'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:01.913842 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-eba54d63-1293-4edb-ad90-59dfc860a47a None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:01.915115 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-eba54d63-1293-4edb-ad90-59dfc860a47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:01.917543 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1423/2847] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:21:01 2022] DELETE /identity/v3/users/53de3bf5ee324f029965d1e0f6206877 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:21:01.977774 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1425/2848] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:21:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:21:01.990301 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:01.991763 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:02.012293 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:02.063113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181012-bee2-4c74-8f65-370b7ca7faa0 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:02.068382 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ede100-bc2b-4f64-b2d7-9814c5ff42bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:02.069041 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ede100-bc2b-4f64-b2d7-9814c5ff42bc service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:02.069327 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ede100-bc2b-4f64-b2d7-9814c5ff42bc service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:02.069605 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ede100-bc2b-4f64-b2d7-9814c5ff42bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:02.081916 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ede100-bc2b-4f64-b2d7-9814c5ff42bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:02.086887 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ede100-bc2b-4f64-b2d7-9814c5ff42bc service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:02.092752 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1424/2849] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:21:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:21:02.182003 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba54d63-1293-4edb-ad90-59dfc860a47a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:02.183396 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-eba54d63-1293-4edb-ad90-59dfc860a47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:02.199606 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:02.253978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba54d63-1293-4edb-ad90-59dfc860a47a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:02.258601 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:02.259504 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:02.259824 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:02.260119 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] PATH_INFO: `/v3/projects/da3a84000d4d40eb9b27644011eddaa9` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:02.261305 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3a84000d4d40eb9b27644011eddaa9)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:02.264139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:02.370818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3a84000d4d40eb9b27644011eddaa9', 'request_id': 'req-bdce1242-a2b9-4654-ac5d-8a63d16d2261'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:02.443201 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3a84000d4d40eb9b27644011eddaa9', 'request_id': 'req-bdce1242-a2b9-4654-ac5d-8a63d16d2261'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:02.450233 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3a84000d4d40eb9b27644011eddaa9', 'request_id': 'req-bdce1242-a2b9-4654-ac5d-8a63d16d2261'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:02.462486 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] The token cache is being invalidate because project da3a84000d4d40eb9b27644011eddaa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:21:02.462823 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:02.463623 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-bdce1242-a2b9-4654-ac5d-8a63d16d2261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:02.465238 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1426/2850] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:21:02 2022] DELETE /identity/v3/projects/da3a84000d4d40eb9b27644011eddaa9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:21:02.470037 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ede100-bc2b-4f64-b2d7-9814c5ff42bc service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:02.480772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ede100-bc2b-4f64-b2d7-9814c5ff42bc service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:02.541137 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2282f-2fc7-40e6-b457-9f5c93e9267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:02.547422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2282f-2fc7-40e6-b457-9f5c93e9267e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:02.547422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2282f-2fc7-40e6-b457-9f5c93e9267e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:02.547422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2282f-2fc7-40e6-b457-9f5c93e9267e admin admin] PATH_INFO: `/v3/users/5f6b04203a7d43d2a47004a69ad5d115` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:02.547422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2282f-2fc7-40e6-b457-9f5c93e9267e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6b04203a7d43d2a47004a69ad5d115)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:02.547422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2282f-2fc7-40e6-b457-9f5c93e9267e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:02.668567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f2af-3b1a-4511-b566-ecbdb2958d3f None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:02.668863 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f2af-3b1a-4511-b566-ecbdb2958d3f None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:02.669148 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139f2af-3b1a-4511-b566-ecbdb2958d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:02.687890 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-f139f2af-3b1a-4511-b566-ecbdb2958d3f None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:02.689124 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f139f2af-3b1a-4511-b566-ecbdb2958d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:02.744002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1427/2851] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 2 10:21:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:21:02.758004 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f2af-3b1a-4511-b566-ecbdb2958d3f None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:02.759426 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-f139f2af-3b1a-4511-b566-ecbdb2958d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:02.772165 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-07b2282f-2fc7-40e6-b457-9f5c93e9267e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6b04203a7d43d2a47004a69ad5d115'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:02.806687 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:02.827951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139f2af-3b1a-4511-b566-ecbdb2958d3f None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:02.833145 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c9583-5652-48cd-8e09-88bd380b356d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:02.833827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c9583-5652-48cd-8e09-88bd380b356d service swift] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:02.834072 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c9583-5652-48cd-8e09-88bd380b356d service swift] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:02.834351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c9583-5652-48cd-8e09-88bd380b356d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:02.842783 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c9583-5652-48cd-8e09-88bd380b356d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:02.844425 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c9583-5652-48cd-8e09-88bd380b356d service swift] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:02.849364 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-07b2282f-2fc7-40e6-b457-9f5c93e9267e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6b04203a7d43d2a47004a69ad5d115'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:02.853059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1428/2852] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:21:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:21:02.877707 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-07b2282f-2fc7-40e6-b457-9f5c93e9267e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6b04203a7d43d2a47004a69ad5d115'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:02.878456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-07b2282f-2fc7-40e6-b457-9f5c93e9267e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6b04203a7d43d2a47004a69ad5d115'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:02.879070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-07b2282f-2fc7-40e6-b457-9f5c93e9267e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6b04203a7d43d2a47004a69ad5d115'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:02.897113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1425/2853] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:21:02 2022] DELETE /identity/v3/users/5f6b04203a7d43d2a47004a69ad5d115 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:21:03.142535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c9583-5652-48cd-8e09-88bd380b356d service swift] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:03.144223 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e99c9583-5652-48cd-8e09-88bd380b356d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:03.165141 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c9583-5652-48cd-8e09-88bd380b356d service swift] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:03.224567 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:03.225431 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:03.225734 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:03.226043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] PATH_INFO: `/v3/projects/646f9bca905a480f843202074a3b2f54` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:03.227333 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=646f9bca905a480f843202074a3b2f54)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:03.229296 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:03.382636 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646f9bca905a480f843202074a3b2f54', 'request_id': 'req-5cb5a34a-3607-42cd-a1b0-377d60250376'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:03.454591 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646f9bca905a480f843202074a3b2f54', 'request_id': 'req-5cb5a34a-3607-42cd-a1b0-377d60250376'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:03.461951 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646f9bca905a480f843202074a3b2f54', 'request_id': 'req-5cb5a34a-3607-42cd-a1b0-377d60250376'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:03.477582 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] The token cache is being invalidate because project 646f9bca905a480f843202074a3b2f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:21:03.477978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:03.478516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-5cb5a34a-3607-42cd-a1b0-377d60250376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:03.480097 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1429/2854] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:21:03 2022] DELETE /identity/v3/projects/646f9bca905a480f843202074a3b2f54 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:21:03.485764 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc3a24-ed17-406b-95e1-f26f92e12f4a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:03.487314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc3a24-ed17-406b-95e1-f26f92e12f4a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:03.487314 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc3a24-ed17-406b-95e1-f26f92e12f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:03.504883 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f2bc3a24-ed17-406b-95e1-f26f92e12f4a None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:03.506072 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f2bc3a24-ed17-406b-95e1-f26f92e12f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:03.529278 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:03.570025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1426/2855] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:03.578017 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254b073-9726-4e60-a9d6-b704b9bf8108 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:03.578312 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254b073-9726-4e60-a9d6-b704b9bf8108 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:03.578598 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254b073-9726-4e60-a9d6-b704b9bf8108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:03.597351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-e254b073-9726-4e60-a9d6-b704b9bf8108 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:03.598566 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-e254b073-9726-4e60-a9d6-b704b9bf8108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:03.606475 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1430/2856] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:03.611368 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc3a24-ed17-406b-95e1-f26f92e12f4a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:03.622162 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc3a24-ed17-406b-95e1-f26f92e12f4a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:03.627442 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34245df-b3e6-472f-a091-0ab6a3d66ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:03.628135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34245df-b3e6-472f-a091-0ab6a3d66ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:03.628422 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34245df-b3e6-472f-a091-0ab6a3d66ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:03.629160 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34245df-b3e6-472f-a091-0ab6a3d66ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:03.629491 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34245df-b3e6-472f-a091-0ab6a3d66ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:21:03.629805 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34245df-b3e6-472f-a091-0ab6a3d66ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:03.631444 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34245df-b3e6-472f-a091-0ab6a3d66ad1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:03.644259 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1427/2857] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 10:21:03.648791 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254b073-9726-4e60-a9d6-b704b9bf8108 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:03.658533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254b073-9726-4e60-a9d6-b704b9bf8108 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:03.663222 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11afadb-6e30-4f97-910f-03de49f8445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:03.663938 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11afadb-6e30-4f97-910f-03de49f8445c admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:03.664219 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11afadb-6e30-4f97-910f-03de49f8445c admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:03.664494 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11afadb-6e30-4f97-910f-03de49f8445c admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:03.667211 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11afadb-6e30-4f97-910f-03de49f8445c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:03.669805 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11afadb-6e30-4f97-910f-03de49f8445c admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:03.751271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1431/2858] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:21:03 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:21:03.753173 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34245df-b3e6-472f-a091-0ab6a3d66ad1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:03.764058 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34245df-b3e6-472f-a091-0ab6a3d66ad1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:03.821852 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c0fc1-d11c-4650-819f-4f35511261d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:03.822522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c0fc1-d11c-4650-819f-4f35511261d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:03.822810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c0fc1-d11c-4650-819f-4f35511261d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:03.823092 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c0fc1-d11c-4650-819f-4f35511261d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:03.823816 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c0fc1-d11c-4650-819f-4f35511261d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:03.825951 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c0fc1-d11c-4650-819f-4f35511261d8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:03.941269 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1428/2859] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:21:03 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:21:03.945403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11afadb-6e30-4f97-910f-03de49f8445c admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:03.956464 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11afadb-6e30-4f97-910f-03de49f8445c admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:03.961001 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4f1a4-1705-41c3-a24f-91c69d5b27c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:03.961653 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4f1a4-1705-41c3-a24f-91c69d5b27c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:03.961937 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4f1a4-1705-41c3-a24f-91c69d5b27c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:03.962213 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4f1a4-1705-41c3-a24f-91c69d5b27c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:03.963000 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4f1a4-1705-41c3-a24f-91c69d5b27c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:03.964638 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4f1a4-1705-41c3-a24f-91c69d5b27c2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:03.975618 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1432/2860] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:21:03.979492 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c0fc1-d11c-4650-819f-4f35511261d8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:03.990004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c0fc1-d11c-4650-819f-4f35511261d8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:03.996070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76b584-f87a-4662-96ae-a3879943b328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:03.996070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76b584-f87a-4662-96ae-a3879943b328 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:03.996070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76b584-f87a-4662-96ae-a3879943b328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:03.996070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76b584-f87a-4662-96ae-a3879943b328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:03.996476 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76b584-f87a-4662-96ae-a3879943b328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:03.998070 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76b584-f87a-4662-96ae-a3879943b328 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:04.007750 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1429/2861] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:21:04.011739 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4f1a4-1705-41c3-a24f-91c69d5b27c2 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:04.024749 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4f1a4-1705-41c3-a24f-91c69d5b27c2 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:04.029063 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfac4ab-aac2-43e1-8bfe-b5f9f76f2167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:04.029956 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfac4ab-aac2-43e1-8bfe-b5f9f76f2167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:04.030291 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfac4ab-aac2-43e1-8bfe-b5f9f76f2167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:04.030706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfac4ab-aac2-43e1-8bfe-b5f9f76f2167 admin admin] PATH_INFO: `/v3/projects/5732654b36444703a17c3c00fe4a9511/users/5216f270184e4cb8bbb1cfa72176500d/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:04.050349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfac4ab-aac2-43e1-8bfe-b5f9f76f2167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5732654b36444703a17c3c00fe4a9511, user_id=5216f270184e4cb8bbb1cfa72176500d, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:04.053671 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfac4ab-aac2-43e1-8bfe-b5f9f76f2167 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:04.131035 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1433/2862] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:21:04 2022] PUT /identity/v3/projects/5732654b36444703a17c3c00fe4a9511/users/5216f270184e4cb8bbb1cfa72176500d/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:21:04.199530 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fa532-f133-48ae-9419-2e10fb6b29cc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:04.199826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fa532-f133-48ae-9419-2e10fb6b29cc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:04.200103 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fa532-f133-48ae-9419-2e10fb6b29cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:04.230965 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fe8fa532-f133-48ae-9419-2e10fb6b29cc None None] MFA Rules not processed for user `5216f270184e4cb8bbb1cfa72176500d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:04.232270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fe8fa532-f133-48ae-9419-2e10fb6b29cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:04.300274 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1430/2863] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:21:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:21:04.310992 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfac4ab-aac2-43e1-8bfe-b5f9f76f2167 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:04.313368 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-7cfac4ab-aac2-43e1-8bfe-b5f9f76f2167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:04.318588 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:04.370795 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfac4ab-aac2-43e1-8bfe-b5f9f76f2167 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:04.374962 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccde84-5ad2-4b03-a23a-185d648769e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0faacba133664123b4046de741073bc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:04.376386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccde84-5ad2-4b03-a23a-185d648769e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:04.376386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccde84-5ad2-4b03-a23a-185d648769e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:04.376386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccde84-5ad2-4b03-a23a-185d648769e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:04.385057 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccde84-5ad2-4b03-a23a-185d648769e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:04.386507 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccde84-5ad2-4b03-a23a-185d648769e1 service cinder] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:04.396941 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1434/2864] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:21:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:21:05.550860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fa532-f133-48ae-9419-2e10fb6b29cc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:05.552298 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fe8fa532-f133-48ae-9419-2e10fb6b29cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:05.579469 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:05.619654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fa532-f133-48ae-9419-2e10fb6b29cc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:05.626147 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:05.627031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:05.630714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:05.630714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] PATH_INFO: `/v3/users/b82496c07cbc4319825c162fad2ef077` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:05.630714 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82496c07cbc4319825c162fad2ef077)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:05.631231 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:05.862962 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82496c07cbc4319825c162fad2ef077'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:05.934562 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82496c07cbc4319825c162fad2ef077'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:05.948198 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82496c07cbc4319825c162fad2ef077'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:05.948858 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82496c07cbc4319825c162fad2ef077'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:05.949628 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82496c07cbc4319825c162fad2ef077'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:05.962517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1431/2865] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:21:05 2022] DELETE /identity/v3/users/b82496c07cbc4319825c162fad2ef077 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:21:05.967903 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a4cc-433d-4ecb-879b-231f655328fe None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:05.968375 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a4cc-433d-4ecb-879b-231f655328fe None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:05.968502 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9a4cc-433d-4ecb-879b-231f655328fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:05.988640 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-41d9a4cc-433d-4ecb-879b-231f655328fe None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:05.989870 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-41d9a4cc-433d-4ecb-879b-231f655328fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:06.048386 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1435/2866] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:06.058094 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:06.059547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:06.116626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b722d7-13fa-47bb-b0c1-d2b6bc054b58 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:06.120212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607bb47-01a2-4e75-b793-f1e33c01101b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:06.120974 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607bb47-01a2-4e75-b793-f1e33c01101b service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:06.121258 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607bb47-01a2-4e75-b793-f1e33c01101b service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:06.121533 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607bb47-01a2-4e75-b793-f1e33c01101b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:06.130814 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607bb47-01a2-4e75-b793-f1e33c01101b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:06.132249 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607bb47-01a2-4e75-b793-f1e33c01101b service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:06.141712 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1432/2867] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:21:06.399897 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9a4cc-433d-4ecb-879b-231f655328fe None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:06.402574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-41d9a4cc-433d-4ecb-879b-231f655328fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:06.438237 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9a4cc-433d-4ecb-879b-231f655328fe None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:06.444435 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:06.445450 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:06.446064 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:06.446403 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] PATH_INFO: `/v3/projects/6f9a44959c764a16bf51132ab57bba52` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:06.448013 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f9a44959c764a16bf51132ab57bba52)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:06.450112 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:06.594309 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f9a44959c764a16bf51132ab57bba52', 'request_id': 'req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:06.688989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f9a44959c764a16bf51132ab57bba52', 'request_id': 'req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:06.695827 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f9a44959c764a16bf51132ab57bba52', 'request_id': 'req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:06.708198 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] The token cache is being invalidate because project 6f9a44959c764a16bf51132ab57bba52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:21:06.708513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:06.709165 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:06.710871 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1436/2868] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:21:06 2022] DELETE /identity/v3/projects/6f9a44959c764a16bf51132ab57bba52 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:21:13.904700 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607bb47-01a2-4e75-b793-f1e33c01101b service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:13.906139 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c607bb47-01a2-4e75-b793-f1e33c01101b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:13.917673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607bb47-01a2-4e75-b793-f1e33c01101b service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:13.960986 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:13.968638 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f48cb-f26e-4d7f-9c7e-6b30e13c8e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:13.976772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f48cb-f26e-4d7f-9c7e-6b30e13c8e90 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:13.976772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f48cb-f26e-4d7f-9c7e-6b30e13c8e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:13.976772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f48cb-f26e-4d7f-9c7e-6b30e13c8e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:13.976772 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-963f48cb-f26e-4d7f-9c7e-6b30e13c8e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:13.981475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f48cb-f26e-4d7f-9c7e-6b30e13c8e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:13.982826 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f48cb-f26e-4d7f-9c7e-6b30e13c8e90 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:13.992334 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1433/2869] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:21:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:21:14.066160 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:14.067613 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:14.079777 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720117a5-a148-4c4f-9cc0-a14e7ef4dee8 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:14.083271 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae8e1a-d502-4eac-9aea-3aa8e8e6f83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:14.083943 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8e1a-d502-4eac-9aea-3aa8e8e6f83e service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:14.084232 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8e1a-d502-4eac-9aea-3aa8e8e6f83e service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:14.084509 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae8e1a-d502-4eac-9aea-3aa8e8e6f83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:14.086255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ceae8e1a-d502-4eac-9aea-3aa8e8e6f83e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:14.114221 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:14.158444 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae8e1a-d502-4eac-9aea-3aa8e8e6f83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:14.159935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae8e1a-d502-4eac-9aea-3aa8e8e6f83e service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:14.170769 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1437/2870] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:21:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:21:15.666566 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f48cb-f26e-4d7f-9c7e-6b30e13c8e90 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:15.668067 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-963f48cb-f26e-4d7f-9c7e-6b30e13c8e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:15.736151 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f48cb-f26e-4d7f-9c7e-6b30e13c8e90 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:15.740654 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:15.741531 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:15.741811 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:15.742086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] PATH_INFO: `/v3/users/5216f270184e4cb8bbb1cfa72176500d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:15.743315 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5216f270184e4cb8bbb1cfa72176500d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:15.745272 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:15.965793 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5216f270184e4cb8bbb1cfa72176500d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:16.032961 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5216f270184e4cb8bbb1cfa72176500d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:16.046585 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5216f270184e4cb8bbb1cfa72176500d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:16.047402 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5216f270184e4cb8bbb1cfa72176500d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:16.048053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5216f270184e4cb8bbb1cfa72176500d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:16.060385 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1434/2871] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:21:15 2022] DELETE /identity/v3/users/5216f270184e4cb8bbb1cfa72176500d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:21:16.065457 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e089e1-db86-4999-a33d-dc6b47f086d4 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:16.065925 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e089e1-db86-4999-a33d-dc6b47f086d4 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:16.066024 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e089e1-db86-4999-a33d-dc6b47f086d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:16.083460 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-04e089e1-db86-4999-a33d-dc6b47f086d4 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:16.084685 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-04e089e1-db86-4999-a33d-dc6b47f086d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:16.143633 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1438/2872] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:16.153404 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:16.154809 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:16.216919 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e989cf7-57b2-4845-90e3-8c33213f7691 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:16.221079 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67ede5-9df2-4820-ad58-fd827e15c005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:16.221729 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ede5-9df2-4820-ad58-fd827e15c005 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:16.222015 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ede5-9df2-4820-ad58-fd827e15c005 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:16.222294 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ede5-9df2-4820-ad58-fd827e15c005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:16.232262 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ede5-9df2-4820-ad58-fd827e15c005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:16.233708 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ede5-9df2-4820-ad58-fd827e15c005 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:16.244292 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1435/2873] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:21:16.902582 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e089e1-db86-4999-a33d-dc6b47f086d4 None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:16.904147 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-04e089e1-db86-4999-a33d-dc6b47f086d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:16.918276 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e089e1-db86-4999-a33d-dc6b47f086d4 None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:16.924172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:16.925078 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:16.925434 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:16.925811 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] PATH_INFO: `/v3/projects/5732654b36444703a17c3c00fe4a9511` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:16.927203 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5732654b36444703a17c3c00fe4a9511)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:16.929294 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:17.083916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5732654b36444703a17c3c00fe4a9511', 'request_id': 'req-d772b049-8d78-4797-acb4-1449e5197493'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:17.180290 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5732654b36444703a17c3c00fe4a9511', 'request_id': 'req-d772b049-8d78-4797-acb4-1449e5197493'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:17.187043 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5732654b36444703a17c3c00fe4a9511', 'request_id': 'req-d772b049-8d78-4797-acb4-1449e5197493'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:17.197544 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] The token cache is being invalidate because project 5732654b36444703a17c3c00fe4a9511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80300) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:21:17.197837 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:17.198466 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d772b049-8d78-4797-acb4-1449e5197493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:21:17.200052 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1439/2874] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:21:16 2022] DELETE /identity/v3/projects/5732654b36444703a17c3c00fe4a9511 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:21:17.206588 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566fc6-8620-476d-a81f-2d6dbccdf187 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:17.207080 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566fc6-8620-476d-a81f-2d6dbccdf187 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:17.207225 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3566fc6-8620-476d-a81f-2d6dbccdf187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:17.226144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a3566fc6-8620-476d-a81f-2d6dbccdf187 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:17.227475 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a3566fc6-8620-476d-a81f-2d6dbccdf187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:17.231963 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:17.289088 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1436/2875] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:17.297748 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698df1c-8226-48a9-ac4b-063c88d2cdca None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:17.298039 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698df1c-8226-48a9-ac4b-063c88d2cdca None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:17.298316 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698df1c-8226-48a9-ac4b-063c88d2cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:17.316778 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-a698df1c-8226-48a9-ac4b-063c88d2cdca None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:17.317984 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-a698df1c-8226-48a9-ac4b-063c88d2cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:17.325978 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1440/2876] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:17.330200 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3566fc6-8620-476d-a81f-2d6dbccdf187 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:17.339960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3566fc6-8620-476d-a81f-2d6dbccdf187 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:17.345559 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451ea16-d3c6-4b6a-bb81-d9b28179c69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:17.346212 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451ea16-d3c6-4b6a-bb81-d9b28179c69e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:17.346504 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451ea16-d3c6-4b6a-bb81-d9b28179c69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:17.346788 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451ea16-d3c6-4b6a-bb81-d9b28179c69e admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:17.347516 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451ea16-d3c6-4b6a-bb81-d9b28179c69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 10:21:17.347862 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451ea16-d3c6-4b6a-bb81-d9b28179c69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:17.349515 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451ea16-d3c6-4b6a-bb81-d9b28179c69e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:17.362183 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1437/2877] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jun 2 10:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 10:21:17.366398 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698df1c-8226-48a9-ac4b-063c88d2cdca None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:17.375754 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698df1c-8226-48a9-ac4b-063c88d2cdca None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:17.380382 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0f834-e2c0-411b-ad1e-f6dcf30e53c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:17.381031 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0f834-e2c0-411b-ad1e-f6dcf30e53c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:17.381319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0f834-e2c0-411b-ad1e-f6dcf30e53c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:17.381600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0f834-e2c0-411b-ad1e-f6dcf30e53c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:17.382291 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0f834-e2c0-411b-ad1e-f6dcf30e53c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:17.384316 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0f834-e2c0-411b-ad1e-f6dcf30e53c7 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:17.467307 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1441/2878] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:21:17 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:21:17.472349 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451ea16-d3c6-4b6a-bb81-d9b28179c69e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:17.482483 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451ea16-d3c6-4b6a-bb81-d9b28179c69e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:17.542288 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175aea3-b812-4e4a-a938-fd99ea453d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:17.542960 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175aea3-b812-4e4a-a938-fd99ea453d1a admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:17.543244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175aea3-b812-4e4a-a938-fd99ea453d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:17.543520 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175aea3-b812-4e4a-a938-fd99ea453d1a admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:17.544252 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175aea3-b812-4e4a-a938-fd99ea453d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:17.546217 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175aea3-b812-4e4a-a938-fd99ea453d1a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:17.608517 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1438/2879] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:21:17 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:21:17.616467 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0f834-e2c0-411b-ad1e-f6dcf30e53c7 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:17.623560 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0f834-e2c0-411b-ad1e-f6dcf30e53c7 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:17.628516 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c91b1-e4b8-4538-8433-275c920ef195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:17.629178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c91b1-e4b8-4538-8433-275c920ef195 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:17.629465 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c91b1-e4b8-4538-8433-275c920ef195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:17.629744 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c91b1-e4b8-4538-8433-275c920ef195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:17.630531 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c91b1-e4b8-4538-8433-275c920ef195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:17.632174 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c91b1-e4b8-4538-8433-275c920ef195 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:17.634422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:17.648537 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1442/2880] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:21:17.649670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175aea3-b812-4e4a-a938-fd99ea453d1a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:17.660739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175aea3-b812-4e4a-a938-fd99ea453d1a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:17.665579 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcd970-57d9-4da2-9e88-d4c73e769eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:17.666237 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcd970-57d9-4da2-9e88-d4c73e769eff admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:17.666522 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcd970-57d9-4da2-9e88-d4c73e769eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:17.666800 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcd970-57d9-4da2-9e88-d4c73e769eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:17.667525 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcd970-57d9-4da2-9e88-d4c73e769eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:17.669216 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcd970-57d9-4da2-9e88-d4c73e769eff admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:17.679303 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1439/2881] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 10:21:17.683414 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c91b1-e4b8-4538-8433-275c920ef195 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:17.694909 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c91b1-e4b8-4538-8433-275c920ef195 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:17.699662 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee90ce-4a8e-4669-b6bf-9b121b094368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:17.700535 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee90ce-4a8e-4669-b6bf-9b121b094368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:17.700817 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee90ce-4a8e-4669-b6bf-9b121b094368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:17.701093 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee90ce-4a8e-4669-b6bf-9b121b094368 admin admin] PATH_INFO: `/v3/projects/a1cbd1bf02f6431a8e3dbebbecd4a7b4/users/c9df55aabcb9472c8309361cb0f1c507/roles/67cb3b4802a642ae98a93929ca7b724c` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:17.716362 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee90ce-4a8e-4669-b6bf-9b121b094368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cbd1bf02f6431a8e3dbebbecd4a7b4, user_id=c9df55aabcb9472c8309361cb0f1c507, role_id=67cb3b4802a642ae98a93929ca7b724c)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:17.719844 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee90ce-4a8e-4669-b6bf-9b121b094368 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:17.774032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1443/2882] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:21:17 2022] PUT /identity/v3/projects/a1cbd1bf02f6431a8e3dbebbecd4a7b4/users/c9df55aabcb9472c8309361cb0f1c507/roles/67cb3b4802a642ae98a93929ca7b724c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:21:17.779120 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18a2ba-f62a-4887-bc3c-2fa8513633c5 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:17.779408 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18a2ba-f62a-4887-bc3c-2fa8513633c5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:17.779731 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18a2ba-f62a-4887-bc3c-2fa8513633c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:17.797971 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7e18a2ba-f62a-4887-bc3c-2fa8513633c5 None None] MFA Rules not processed for user `ac2534ecb2984be38b622993992d8d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:17.799150 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7e18a2ba-f62a-4887-bc3c-2fa8513633c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:17.856789 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1440/2883] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:17.866680 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee90ce-4a8e-4669-b6bf-9b121b094368 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:17.868032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-c2ee90ce-4a8e-4669-b6bf-9b121b094368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:17.925829 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee90ce-4a8e-4669-b6bf-9b121b094368 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:17.929578 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c3d05-05a9-4984-894a-0baa2b3810b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:17.930226 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c3d05-05a9-4984-894a-0baa2b3810b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:17.930513 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c3d05-05a9-4984-894a-0baa2b3810b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:17.930793 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c3d05-05a9-4984-894a-0baa2b3810b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:17.940533 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c3d05-05a9-4984-894a-0baa2b3810b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:17.941969 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c3d05-05a9-4984-894a-0baa2b3810b7 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:17.951443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1444/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:21:23.330474 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb368-3ceb-4120-9f33-bdd0ba05b86b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:23.331023 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb368-3ceb-4120-9f33-bdd0ba05b86b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:23.331135 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fb368-3ceb-4120-9f33-bdd0ba05b86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:23.360384 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fe2fb368-3ceb-4120-9f33-bdd0ba05b86b None None] MFA Rules not processed for user `c9df55aabcb9472c8309361cb0f1c507`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:23.361809 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fe2fb368-3ceb-4120-9f33-bdd0ba05b86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:23.366127 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:23.430812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1441/2885] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:21:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 10:21:23.435318 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c3d05-05a9-4984-894a-0baa2b3810b7 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:23.446163 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c3d05-05a9-4984-894a-0baa2b3810b7 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:23.450815 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec201f0-f4b7-4c6c-b822-0b00846d57b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:23.451929 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec201f0-f4b7-4c6c-b822-0b00846d57b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:23.451929 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec201f0-f4b7-4c6c-b822-0b00846d57b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:23.452178 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec201f0-f4b7-4c6c-b822-0b00846d57b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:23.452904 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec201f0-f4b7-4c6c-b822-0b00846d57b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:23.454787 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec201f0-f4b7-4c6c-b822-0b00846d57b4 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:23.525349 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1445/2886] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jun 2 10:21:23 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 10:21:23.529471 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fb368-3ceb-4120-9f33-bdd0ba05b86b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:23.541941 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fb368-3ceb-4120-9f33-bdd0ba05b86b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:23.610968 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82b80a-f809-46a9-9afb-1cfa80bc6180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:23.611889 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82b80a-f809-46a9-9afb-1cfa80bc6180 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:23.612273 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82b80a-f809-46a9-9afb-1cfa80bc6180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:23.612649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82b80a-f809-46a9-9afb-1cfa80bc6180 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:23.613493 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82b80a-f809-46a9-9afb-1cfa80bc6180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:23.615694 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82b80a-f809-46a9-9afb-1cfa80bc6180 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:23.691620 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1442/2887] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jun 2 10:21:23 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 10:21:23.695840 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec201f0-f4b7-4c6c-b822-0b00846d57b4 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:23.706231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec201f0-f4b7-4c6c-b822-0b00846d57b4 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:23.711319 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20679-1f03-43c1-b661-a1973cd14cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:23.712032 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20679-1f03-43c1-b661-a1973cd14cae admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:23.712325 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20679-1f03-43c1-b661-a1973cd14cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:23.712609 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb20679-1f03-43c1-b661-a1973cd14cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:23.717422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb20679-1f03-43c1-b661-a1973cd14cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:23.717422 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb20679-1f03-43c1-b661-a1973cd14cae admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:23.727164 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1446/2888] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:21:23.731846 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82b80a-f809-46a9-9afb-1cfa80bc6180 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:23.743870 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82b80a-f809-46a9-9afb-1cfa80bc6180 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:23.748584 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0eddc-3cb9-4a66-995c-feaf75c24794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:23.749452 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0eddc-3cb9-4a66-995c-feaf75c24794 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:23.750328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0eddc-3cb9-4a66-995c-feaf75c24794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:23.750704 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0eddc-3cb9-4a66-995c-feaf75c24794 admin admin] PATH_INFO: `/v3/projects/805814db6bfb48ca8c7a2d6f6cadac13/users/44bdde1dce9d4d93be2faf3e03fb5d71/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:23.766486 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0eddc-3cb9-4a66-995c-feaf75c24794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805814db6bfb48ca8c7a2d6f6cadac13, user_id=44bdde1dce9d4d93be2faf3e03fb5d71, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:23.769154 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0eddc-3cb9-4a66-995c-feaf75c24794 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:23.867111 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1443/2889] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:21:23 2022] PUT /identity/v3/projects/805814db6bfb48ca8c7a2d6f6cadac13/users/44bdde1dce9d4d93be2faf3e03fb5d71/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:21:23.871223 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20679-1f03-43c1-b661-a1973cd14cae admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:23.889251 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb20679-1f03-43c1-b661-a1973cd14cae admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:23.960322 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb10946-7692-41b1-b454-372e87ef7ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:23.961011 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb10946-7692-41b1-b454-372e87ef7ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:23.961301 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb10946-7692-41b1-b454-372e87ef7ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:23.961588 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb10946-7692-41b1-b454-372e87ef7ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:23.962547 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb10946-7692-41b1-b454-372e87ef7ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:23.964231 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb10946-7692-41b1-b454-372e87ef7ce9 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:23.976079 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1447/2890] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jun 2 10:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 10:21:23.980395 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0eddc-3cb9-4a66-995c-feaf75c24794 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:23.996025 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0eddc-3cb9-4a66-995c-feaf75c24794 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:24.001959 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fca1a1-9cce-425d-92c2-9db2a661c658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:24.002864 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fca1a1-9cce-425d-92c2-9db2a661c658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:24.009192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fca1a1-9cce-425d-92c2-9db2a661c658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:24.009192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fca1a1-9cce-425d-92c2-9db2a661c658 admin admin] PATH_INFO: `/v3/projects/805814db6bfb48ca8c7a2d6f6cadac13/users/44bdde1dce9d4d93be2faf3e03fb5d71/roles/918b179f19b6437493eabe5394fa9af0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:24.009192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fca1a1-9cce-425d-92c2-9db2a661c658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805814db6bfb48ca8c7a2d6f6cadac13, user_id=44bdde1dce9d4d93be2faf3e03fb5d71, role_id=918b179f19b6437493eabe5394fa9af0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:24.009192 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fca1a1-9cce-425d-92c2-9db2a661c658 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:24.020739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1444/2891] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jun 2 10:21:23 2022] PUT /identity/v3/projects/805814db6bfb48ca8c7a2d6f6cadac13/users/44bdde1dce9d4d93be2faf3e03fb5d71/roles/918b179f19b6437493eabe5394fa9af0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:21:29.562025 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82373d74-173d-4168-9995-6f73c118b6c3 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:29.563059 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82373d74-173d-4168-9995-6f73c118b6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:29.563298 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82373d74-173d-4168-9995-6f73c118b6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:29.590392 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-82373d74-173d-4168-9995-6f73c118b6c3 None None] MFA Rules not processed for user `44bdde1dce9d4d93be2faf3e03fb5d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:29.591026 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-82373d74-173d-4168-9995-6f73c118b6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:29.621092 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:29.662940 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1448/2892] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:21:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:29.676445 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fca1a1-9cce-425d-92c2-9db2a661c658 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:29.679607 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-16fca1a1-9cce-425d-92c2-9db2a661c658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:29.743236 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fca1a1-9cce-425d-92c2-9db2a661c658 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:29.747895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0ed74-d566-4f77-915f-26318e6322ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10d089c711a94b70a198e35443ee7ea5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:29.747895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0ed74-d566-4f77-915f-26318e6322ba service glance] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:29.748259 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0ed74-d566-4f77-915f-26318e6322ba service glance] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:29.750221 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0ed74-d566-4f77-915f-26318e6322ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:29.761379 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:29.814853 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0ed74-d566-4f77-915f-26318e6322ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:29.822443 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0ed74-d566-4f77-915f-26318e6322ba service glance] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:29.826000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1445/2893] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:21:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:21:30.095915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8626fa-5a6d-48ad-8564-934292c05845 None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:30.096855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8626fa-5a6d-48ad-8564-934292c05845 None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:30.096855 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8626fa-5a6d-48ad-8564-934292c05845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:30.117472 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-fd8626fa-5a6d-48ad-8564-934292c05845 None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:30.118706 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-fd8626fa-5a6d-48ad-8564-934292c05845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:30.178412 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1449/2894] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:21:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:30.190608 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0ed74-d566-4f77-915f-26318e6322ba service glance] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:30.192096 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-75c0ed74-d566-4f77-915f-26318e6322ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:30.267519 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0ed74-d566-4f77-915f-26318e6322ba service glance] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:30.272739 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42827aa9-12ba-4186-9e24-e70e4caee02f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:30.273397 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42827aa9-12ba-4186-9e24-e70e4caee02f service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:30.273680 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42827aa9-12ba-4186-9e24-e70e4caee02f service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:30.273958 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42827aa9-12ba-4186-9e24-e70e4caee02f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:30.283907 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42827aa9-12ba-4186-9e24-e70e4caee02f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:30.285516 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42827aa9-12ba-4186-9e24-e70e4caee02f service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:30.294270 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1446/2895] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:21:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 10:21:40.170825 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=41 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:40.290775 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=54 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:40.390263 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f57599-d9f1-4a68-82ec-11bceb5b668a None None] REQUEST_METHOD: `POST` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:40.390648 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f57599-d9f1-4a68-82ec-11bceb5b668a None None] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:40.391081 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f57599-d9f1-4a68-82ec-11bceb5b668a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:40.409404 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.auth.core [None req-77f57599-d9f1-4a68-82ec-11bceb5b668a None None] MFA Rules not processed for user `c9df55aabcb9472c8309361cb0f1c507`. Rule list: `[]` (Enabled: `True`). {{(pid=80300) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:40.410600 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-77f57599-d9f1-4a68-82ec-11bceb5b668a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:40.417449 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1450/2896] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jun 2 10:21:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:43.636318 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50236b-997a-429e-92e7-0e73238af172 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:43.636808 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50236b-997a-429e-92e7-0e73238af172 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:43.636934 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50236b-997a-429e-92e7-0e73238af172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:43.655812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fb50236b-997a-429e-92e7-0e73238af172 None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:21:43.657006 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fb50236b-997a-429e-92e7-0e73238af172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:21:43.664666 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1447/2897] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jun 2 10:21:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:21:43.677763 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f57599-d9f1-4a68-82ec-11bceb5b668a None None] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:21:43.690975 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f57599-d9f1-4a68-82ec-11bceb5b668a None None] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:21:43.695989 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526d656-0145-468c-ae0b-5fd26615c08d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:21:43.696632 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526d656-0145-468c-ae0b-5fd26615c08d service swift] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:21:43.696916 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526d656-0145-468c-ae0b-5fd26615c08d service swift] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:21:43.697196 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526d656-0145-468c-ae0b-5fd26615c08d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:21:43.706010 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526d656-0145-468c-ae0b-5fd26615c08d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:21:43.707610 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526d656-0145-468c-ae0b-5fd26615c08d service swift] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:21:43.715946 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1451/2898] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:21:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:21:53.650649 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:21:53.712417 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=9 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:08.029523 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50236b-997a-429e-92e7-0e73238af172 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:08.083454 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50236b-997a-429e-92e7-0e73238af172 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:08.086895 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f7b5-7dbf-4b8a-aacf-3715aed59b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:08.087526 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f7b5-7dbf-4b8a-aacf-3715aed59b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:08.087838 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f7b5-7dbf-4b8a-aacf-3715aed59b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:08.088116 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f7b5-7dbf-4b8a-aacf-3715aed59b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:08.097552 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390f7b5-7dbf-4b8a-aacf-3715aed59b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:08.099031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390f7b5-7dbf-4b8a-aacf-3715aed59b21 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:08.108398 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1448/2899] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:22:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:22:18.104387 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=26 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:43.181612 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526d656-0145-468c-ae0b-5fd26615c08d service swift] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:43.191900 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526d656-0145-468c-ae0b-5fd26615c08d service swift] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:43.195488 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188857f-107f-4a3c-8d67-f786e631d336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:43.203029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188857f-107f-4a3c-8d67-f786e631d336 service neutron] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:43.203029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188857f-107f-4a3c-8d67-f786e631d336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:43.203029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188857f-107f-4a3c-8d67-f786e631d336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:43.203029 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5188857f-107f-4a3c-8d67-f786e631d336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:43.269639 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188857f-107f-4a3c-8d67-f786e631d336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:43.271381 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188857f-107f-4a3c-8d67-f786e631d336 service neutron] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:43.282700 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1452/2900] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:22:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:22:48.127786 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f7b5-7dbf-4b8a-aacf-3715aed59b21 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:48.129340 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8390f7b5-7dbf-4b8a-aacf-3715aed59b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:48.140946 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f7b5-7dbf-4b8a-aacf-3715aed59b21 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:48.145266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e1148-ae1c-4773-b40f-0f3ef170c832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:48.145909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e1148-ae1c-4773-b40f-0f3ef170c832 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:48.146465 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e1148-ae1c-4773-b40f-0f3ef170c832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:48.146745 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e1148-ae1c-4773-b40f-0f3ef170c832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:48.148570 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-df7e1148-ae1c-4773-b40f-0f3ef170c832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:48.162956 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e1148-ae1c-4773-b40f-0f3ef170c832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:48.164429 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e1148-ae1c-4773-b40f-0f3ef170c832 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:48.176845 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1449/2901] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:22:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:22:51.310730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188857f-107f-4a3c-8d67-f786e631d336 service neutron] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:51.313007 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5188857f-107f-4a3c-8d67-f786e631d336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:51.377183 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188857f-107f-4a3c-8d67-f786e631d336 service neutron] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:51.381772 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:51.382637 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:51.382930 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:51.383209 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] PATH_INFO: `/v3/users/8f810c90892a4a58b072eb8cc6acb217` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:51.384441 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f810c90892a4a58b072eb8cc6acb217)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:51.386372 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:51.592429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f810c90892a4a58b072eb8cc6acb217'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:51.604323 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f810c90892a4a58b072eb8cc6acb217'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:51.604999 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f810c90892a4a58b072eb8cc6acb217'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:51.612020 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f810c90892a4a58b072eb8cc6acb217'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:51.612692 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f810c90892a4a58b072eb8cc6acb217'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:51.676199 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1453/2902] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:22:51 2022] DELETE /identity/v3/users/8f810c90892a4a58b072eb8cc6acb217 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:22:51.912510 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e1148-ae1c-4773-b40f-0f3ef170c832 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:51.925810 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e1148-ae1c-4773-b40f-0f3ef170c832 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:51.989130 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:51.990118 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:51.990417 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:51.990696 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] PATH_INFO: `/v3/projects/d56c46e9755241f9bd42d00eed614d01` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:51.991922 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d56c46e9755241f9bd42d00eed614d01)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:51.994020 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:52.099930 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56c46e9755241f9bd42d00eed614d01', 'request_id': 'req-d1182929-b58e-411e-8bc7-9aa5ab907971'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:52.105328 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56c46e9755241f9bd42d00eed614d01', 'request_id': 'req-d1182929-b58e-411e-8bc7-9aa5ab907971'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:52.111410 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56c46e9755241f9bd42d00eed614d01', 'request_id': 'req-d1182929-b58e-411e-8bc7-9aa5ab907971'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:52.195488 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] The token cache is being invalidate because project d56c46e9755241f9bd42d00eed614d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:22:52.195812 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:52.196450 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:52.198001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1450/2903] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:22:51 2022] DELETE /identity/v3/projects/d56c46e9755241f9bd42d00eed614d01 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:22:52.202098 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:52.204512 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:52.213985 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:52.217949 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d285dc-9997-433c-9e66-ffde5f718a95 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:52.276504 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:52.277378 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:52.277665 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:52.277944 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] PATH_INFO: `/v3/users/753a421296604c7c994dd3d0f1ff02eb` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:52.279131 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=753a421296604c7c994dd3d0f1ff02eb)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:52.281157 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:52.420955 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753a421296604c7c994dd3d0f1ff02eb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:52.433195 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753a421296604c7c994dd3d0f1ff02eb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:52.433808 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753a421296604c7c994dd3d0f1ff02eb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:52.441102 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753a421296604c7c994dd3d0f1ff02eb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:52.441740 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753a421296604c7c994dd3d0f1ff02eb'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:52.573390 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1454/2904] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:22:52 2022] DELETE /identity/v3/users/753a421296604c7c994dd3d0f1ff02eb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:22:52.820699 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:22:52.822256 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:22:52.836244 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1182929-b58e-411e-8bc7-9aa5ab907971 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:22:52.900697 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:22:52.901574 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:22:52.901860 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:22:52.902187 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] PATH_INFO: `/v3/projects/c805ca4831eb4336843b11df5dcce618` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:22:52.903383 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c805ca4831eb4336843b11df5dcce618)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:22:52.905326 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:22:52.928031 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:22:53.043284 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c805ca4831eb4336843b11df5dcce618', 'request_id': 'req-ff4953a2-d486-4810-b914-12e41574fdfd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:53.049446 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c805ca4831eb4336843b11df5dcce618', 'request_id': 'req-ff4953a2-d486-4810-b914-12e41574fdfd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:53.057254 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c805ca4831eb4336843b11df5dcce618', 'request_id': 'req-ff4953a2-d486-4810-b914-12e41574fdfd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:53.118000 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] The token cache is being invalidate because project c805ca4831eb4336843b11df5dcce618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:22:53.118279 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:53.118967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:22:53.120888 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1451/2905] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:22:52 2022] DELETE /identity/v3/projects/c805ca4831eb4336843b11df5dcce618 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:02.569492 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:03.114673 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:25.887554 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:25.889205 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:26.041850 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca659aa1-f022-4883-b259-4c319f590901 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:26.127572 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e428e-b8c5-47cf-b628-68ef3e088cc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:26.128699 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e428e-b8c5-47cf-b628-68ef3e088cc1 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:26.129329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e428e-b8c5-47cf-b628-68ef3e088cc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:26.129721 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e428e-b8c5-47cf-b628-68ef3e088cc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:26.131818 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-808e428e-b8c5-47cf-b628-68ef3e088cc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:26.146286 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e428e-b8c5-47cf-b628-68ef3e088cc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:26.148224 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e428e-b8c5-47cf-b628-68ef3e088cc1 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:26.164332 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1455/2906] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:23:26.237434 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:26.240001 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:26.304963 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4953a2-d486-4810-b914-12e41574fdfd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:26.308724 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219d2e6-8b3f-495d-8d83-147dafaa2f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9263fa2ac534b7b9e5c6658c871da9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:26.309456 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219d2e6-8b3f-495d-8d83-147dafaa2f04 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:26.310779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219d2e6-8b3f-495d-8d83-147dafaa2f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:26.310779 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219d2e6-8b3f-495d-8d83-147dafaa2f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:26.312129 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b219d2e6-8b3f-495d-8d83-147dafaa2f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:26.323767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219d2e6-8b3f-495d-8d83-147dafaa2f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:26.325382 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219d2e6-8b3f-495d-8d83-147dafaa2f04 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:26.335307 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1452/2907] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:23:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:23:32.306723 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e428e-b8c5-47cf-b628-68ef3e088cc1 service nova] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:32.308172 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-808e428e-b8c5-47cf-b628-68ef3e088cc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:32.322179 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e428e-b8c5-47cf-b628-68ef3e088cc1 service nova] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:32.327716 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e181ba1-054b-4950-afbf-13d1a684de51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba690590103a4019a56b191e8dfe3231', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:32.328353 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e181ba1-054b-4950-afbf-13d1a684de51 service nova] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:32.328640 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e181ba1-054b-4950-afbf-13d1a684de51 service nova] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:32.328917 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e181ba1-054b-4950-afbf-13d1a684de51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:32.330658 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5e181ba1-054b-4950-afbf-13d1a684de51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:32.343508 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e181ba1-054b-4950-afbf-13d1a684de51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:32.345104 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e181ba1-054b-4950-afbf-13d1a684de51 service nova] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:32.356847 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1456/2908] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:23:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:23:33.698095 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea928ed-c8ee-4c3d-8a65-de43fa50dd67 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:33.698563 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea928ed-c8ee-4c3d-8a65-de43fa50dd67 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:33.698659 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea928ed-c8ee-4c3d-8a65-de43fa50dd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:33.716485 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fea928ed-c8ee-4c3d-8a65-de43fa50dd67 None None] MFA Rules not processed for user `386b93ddf5434625850806abb77b4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 10:23:33.717679 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fea928ed-c8ee-4c3d-8a65-de43fa50dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:33.773675 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1453/2909] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jun 2 10:23:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 10:23:33.813586 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e181ba1-054b-4950-afbf-13d1a684de51 service nova] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:33.814976 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-5e181ba1-054b-4950-afbf-13d1a684de51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:33.882314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e181ba1-054b-4950-afbf-13d1a684de51 service nova] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:33.887385 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebc2b4-4594-4eeb-86b2-0e670a3c7a95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ffae8f3b04107b994e57bc880b59b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:33.888071 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc2b4-4594-4eeb-86b2-0e670a3c7a95 service swift] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:33.888360 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc2b4-4594-4eeb-86b2-0e670a3c7a95 service swift] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:33.888640 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc2b4-4594-4eeb-86b2-0e670a3c7a95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:33.897730 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebc2b4-4594-4eeb-86b2-0e670a3c7a95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:33.899339 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebc2b4-4594-4eeb-86b2-0e670a3c7a95 service swift] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:33.903905 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=100 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:33.907802 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1457/2910] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jun 2 10:23:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 10:23:41.617670 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea928ed-c8ee-4c3d-8a65-de43fa50dd67 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:41.619112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fea928ed-c8ee-4c3d-8a65-de43fa50dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:41.691770 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea928ed-c8ee-4c3d-8a65-de43fa50dd67 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:41.697091 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3b5cc-6afa-4bcd-b903-c29d9bed3d3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdf5c7049f8499b8a25c88fbf4cb795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:41.697787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3b5cc-6afa-4bcd-b903-c29d9bed3d3a service placement] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:41.698078 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3b5cc-6afa-4bcd-b903-c29d9bed3d3a service placement] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:41.698356 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3b5cc-6afa-4bcd-b903-c29d9bed3d3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:41.700144 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5ba3b5cc-6afa-4bcd-b903-c29d9bed3d3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:41.712086 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3b5cc-6afa-4bcd-b903-c29d9bed3d3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:41.713643 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3b5cc-6afa-4bcd-b903-c29d9bed3d3a service placement] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:41.724551 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1454/2911] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:23:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 10:23:41.761935 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebc2b4-4594-4eeb-86b2-0e670a3c7a95 service swift] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:41.763565 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-97ebc2b4-4594-4eeb-86b2-0e670a3c7a95 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:41.830663 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebc2b4-4594-4eeb-86b2-0e670a3c7a95 service swift] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:41.835110 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:41.836014 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:41.836299 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:41.836574 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] PATH_INFO: `/v3/users/c9df55aabcb9472c8309361cb0f1c507` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:41.837762 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9df55aabcb9472c8309361cb0f1c507)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:41.839702 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:41.968400 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9df55aabcb9472c8309361cb0f1c507'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:41.980995 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9df55aabcb9472c8309361cb0f1c507'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:41.981689 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9df55aabcb9472c8309361cb0f1c507'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:41.990214 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9df55aabcb9472c8309361cb0f1c507'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:41.992229 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9df55aabcb9472c8309361cb0f1c507'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:42.046473 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1458/2912] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:23:41 2022] DELETE /identity/v3/users/c9df55aabcb9472c8309361cb0f1c507 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:42.282297 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3b5cc-6afa-4bcd-b903-c29d9bed3d3a service placement] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:42.293477 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3b5cc-6afa-4bcd-b903-c29d9bed3d3a service placement] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:42.326655 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:42.351053 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:42.351855 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:42.352143 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:42.352424 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] PATH_INFO: `/v3/projects/a1cbd1bf02f6431a8e3dbebbecd4a7b4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:42.353626 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1cbd1bf02f6431a8e3dbebbecd4a7b4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:42.355532 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:42.470967 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1cbd1bf02f6431a8e3dbebbecd4a7b4', 'request_id': 'req-be0f6900-490c-4609-bbf3-90b5c1e3397c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:42.476767 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1cbd1bf02f6431a8e3dbebbecd4a7b4', 'request_id': 'req-be0f6900-490c-4609-bbf3-90b5c1e3397c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:42.482905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1cbd1bf02f6431a8e3dbebbecd4a7b4', 'request_id': 'req-be0f6900-490c-4609-bbf3-90b5c1e3397c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:42.542497 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] The token cache is being invalidate because project a1cbd1bf02f6431a8e3dbebbecd4a7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:23:42.542787 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:42.543436 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:42.545004 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1455/2913] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:23:42 2022] DELETE /identity/v3/projects/a1cbd1bf02f6431a8e3dbebbecd4a7b4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:42.549018 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:42.550475 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:42.563691 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de8dad-180d-46a4-b9a3-a83bbf924e78 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:42.620366 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:42.621168 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:42.621456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:42.621738 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] PATH_INFO: `/v3/users/44bdde1dce9d4d93be2faf3e03fb5d71` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:42.622927 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44bdde1dce9d4d93be2faf3e03fb5d71)` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:42.624915 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:42.647522 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:42.809255 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44bdde1dce9d4d93be2faf3e03fb5d71'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:42.822456 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44bdde1dce9d4d93be2faf3e03fb5d71'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:42.823125 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44bdde1dce9d4d93be2faf3e03fb5d71'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:42.830351 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44bdde1dce9d4d93be2faf3e03fb5d71'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:42.830986 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.notifications [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44bdde1dce9d4d93be2faf3e03fb5d71'} {{(pid=80300) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:42.904314 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1459/2914] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jun 2 10:23:42 2022] DELETE /identity/v3/users/44bdde1dce9d4d93be2faf3e03fb5d71 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 10:23:43.166261 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:23:43.168029 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:23:43.184705 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f6900-490c-4609-bbf3-90b5c1e3397c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:23:43.243547 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac2534ecb2984be38b622993992d8d0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76cf5bbc77b94e4aad5326febc250cf3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:23:43.244438 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:23:43.244799 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:23:43.245196 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] PATH_INFO: `/v3/projects/805814db6bfb48ca8c7a2d6f6cadac13` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:23:43.246374 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805814db6bfb48ca8c7a2d6f6cadac13)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:23:43.248313 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:23:43.350113 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805814db6bfb48ca8c7a2d6f6cadac13', 'request_id': 'req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:43.355658 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805814db6bfb48ca8c7a2d6f6cadac13', 'request_id': 'req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:43.361905 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805814db6bfb48ca8c7a2d6f6cadac13', 'request_id': 'req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:43.413007 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:43.417616 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] The token cache is being invalidate because project 805814db6bfb48ca8c7a2d6f6cadac13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 10:23:43.417909 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:43.418676 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a67b3c60-70db-4a5a-8fb8-d204b11e6b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 10:23:43.420266 dv-cinder-797608-25-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1456/2915] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jun 2 10:23:43 2022] DELETE /identity/v3/projects/805814db6bfb48ca8c7a2d6f6cadac13 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 10:23:52.900518 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:23:53.492112 dv-cinder-797608-25-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 10:26:53.412002 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] Authenticating user token {{(pid=80300) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 10:26:53.413443 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:53.557329 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1cfd6-4a5c-4989-9908-ff08e0a38fb2 admin admin] Validating token access rules against request {{(pid=80300) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 10:26:53.614487 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a33c1-25e8-4c60-87cf-af20ab277064 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdf5c7049f8499b8a25c88fbf4cb795', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'edd940c54602478f99fa5f4d40e7c7cd', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80300) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 10:26:53.615139 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a33c1-25e8-4c60-87cf-af20ab277064 service placement] REQUEST_METHOD: `GET` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 10:26:53.615429 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a33c1-25e8-4c60-87cf-af20ab277064 service placement] SCRIPT_NAME: `/identity` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 10:26:53.615741 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a33c1-25e8-4c60-87cf-af20ab277064 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80300) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 10:26:53.617517 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.fernet_utils [None req-4e1a33c1-25e8-4c60-87cf-af20ab277064 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80300) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 10:26:53.629264 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a33c1-25e8-4c60-87cf-af20ab277064 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 10:26:53.630854 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a33c1-25e8-4c60-87cf-af20ab277064 service placement] RBAC: Authorization granted {{(pid=80300) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 10:26:53.641376 dv-cinder-797608-25-smb devstack@keystone.service[80300]: [pid: 80300|app: 0|req: 1460/2916] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jun 2 10:26:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 10:27:03.637069 dv-cinder-797608-25-smb devstack@keystone.service[80300]: DEBUG dbcounter [-] [80300] Writing DB stats keystone:SELECT=89 {{(pid=80300) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}